English-Speaking JSON & Coders for Audio Evaluations
Temporary
Lifted, an Upwork Company™
An Enterprise client is seeking a high volume of English-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format.
Work is expected to begin right away, and continue for 2-3 months, with the potential for additional work beyond this initial project. Experts may work at any schedule of their choosing, for as long as tasks are available. Experts (Operators) will review a mix of customer service-style responses and technical content, with a strong focus on coding knowledge, JSON structure, formatting accuracy, and overall response quality. Experts should be comfortable identifying whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines. Fluency in English, as spoken in Canada, the United States, or the United Kingdom, is required. Experts with multilingual fluency may be offered work for this project and/or others, in additional languagesJob Description
Tasks include:
- Participating in live, real-time conversational scenarios with AI systems
- Reviewing and labeling conversation transcripts
- Evaluating AI-generated responses using structured rubrics and providing written justifications
- Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
- Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs - Environment preparation and tool verification before each session
Experts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence.
Qualifications
To be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment, they will be provided with further onboarding steps.
“Operator” requirements:- Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim.
- Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues
- Audio setup: capable of producing clear audio quality with no background noise Ideal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the English-Speaking JSON & Coders for Audio Evaluations in Ontario vacancy
$60k - $75k per year
...Associate Pastor to lead and develop our English Ministry, which currently consists of approximately... ...available, two sermons, either video or audio, that you have preached in your ministry... ...information for four references who can speak to your ministry, including elders,...English language skillsAudioFull timeLocal area- ...Mandarin Alliance Church (ETMAC) is a Mandarin-speaking church under the Christian and Missionary... ...in Canada. We are seeking a full-time English Ministry Pastor to lead and shepherd our... ...to allow for mutual discernment and evaluation before transitioning to a long-term commitment...English language skillsLong term contractFull time
- ...RHCBC, THE CHURCH Richmond Hill (Chinese) Baptist Church (RHCBC) is a trilingual (English, Cantonese and Mandarin) multigenerational church with about 350 members. The English-speaking congregation (ESC) has a regular worship attendance of about 110 people of diverse age...English language skillsLocal areaWeekend work
- ...For our English Ministry we are seeking a worship leader who is talented in music to lead in the area of music ministry. There is a worship team present that needs a gifted worship leader who can lead in the Holy Spirit to grow and nurture the worship team. This position...English language skillsPart timeDay shiftAfternoon shift
- ...We are currently looking for a Spanish-speaking ESOL teacher for one of our clients in... ...Spanish-speaking workers, who need to learn English to integrate into an English-speaking environment... ...Ideal Candidate Be a native English speaker and/or hold a relevant teaching...English language skillsHourly payContract workPart timeFreelanceImmediate startWorldwideFlexible hours
$71.85k - $115.13k per year
...Division Faculty of Academic and Career Preparation Department English Language Learning Campus Nanaimo campus *Successful... ...instruction; provide student support; design and implement student evaluation; grade and record keep; liaise with Student Success Advisors; participate...English language skillsPermanent employmentTemporary workPart timeFlexible hours$60k - $70k per year
...Position title: Associate Pastor (English Ministry) Position status: Full-time permanent Ministries: English Ministry Reports to: English Ministry Charge Pastor Direct reports: None Salary range: $60,000 to $70,000 Vacancy status: Backfill Posting...English language skillsPermanent employmentFull timeLive outLocal areaWeekend work$45k per year
...Alphanumeric is hiring a Bilingual Customer Care Specialist (English/French) for Pharmaceuticals to work remotely supporting one of... ...Requirements: Strong proficiency in English and French (mandatory to speak both languages fluently) Preference for individuals who have a...English language skillsRemote jobPermanent employmentFull timeContract workWork at officeTrial periodMonday to fridayFlexible hoursShift work$160k - $240k per year
...simulated calls using different accents, tones, speaking styles, personalities, and scenarios,... ...events, recordings, transcripts, evaluations, and call outcomes. Improve distributed... ...LiveKit Telephony, SIP, or RTP Voice or audio processing STT/TTS infrastructure...AudioRemote jobLong term contractFull time- ...and the health care team in the development, implementation and evaluation of the resident’s plan of care. In addition to clinical... ...balancing work/life responsibilities. Ability to read, write, and speak English. A satisfactory and current Vulnerable Sector Screening....English language skillsLong term contractRemplacementInternshipWork at office
$32.08 - $47.38 per hour
...in the CCPN Grant - Ontario Health- HFO, some nurses may qualify, speak to your recruiter about eligibility of the $25,000 HFO Grant.... ...s license and vehicle as regular travel is required Excellent English verbal and written communication skills CPR Certification Current...Hourly payFull timePart timeFlexible hoursWeekend workWeekday work- ...communication pieces. Monitor and evaluate the performance of content by... ...grasp of the Canadian English language, both verbal and written... ...new skills ~ Ability to speak and write Canadian French is an... ...travel may be required. Evaluation / Appraisal ~ Performance will...English language skillsFull timeWork at officeRemote work
$40k per year
...Sales Development Representative with us. ~ Proficient in English (reading/writing/speaking). ~1+ year in retail/hospitality/software sales ideally... .... These tools provide one of many data points in our evaluation, but all final hiring decisions are made by our team of humans...English language skillsPermanent employmentFull timeCasual workInternshipWork at officeRemote workMonday to fridayShift work$50k - $70k per year
...planning, monitoring, budgeting, evaluating, and reporting skills.... ...written communication skills in English including reading, writing and... ...with tact and diplomacy when speaking with staff, the public,... ...Provide supervision, coaching, evaluation, support, training, and development...Long term contractFull timeTemporary workSummer workSeasonal workLocal areaRemote work- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This role involves assessing and analyzing audio... ...and objective judgment based on provided evaluation guidelines. • Maintain high quality...English language skillsAudioRemote jobContract workFreelance
$60k per year
...the phone or zoom with high-quality clients. Attending live speaking engagements and webinars (travel capacity). Collaborating for... ...Sales experience in a service industry is also a plus. Excellent English verbal and written communication skills, with the ability to...Full timeFor contractorsRemote work- ...*Have experience or express interest in this field. *Possess strong leadership and communication skills. *Attention to detail. *Speaks the English language fluently. French would be an asset. *Applicants must be able to complete mandatory training in April, prior to season start...English language skillsMinimum wageSummer workSeasonal workLocal areaShift workRotating shiftWeekend workDay shift
$1350 per month
...We are a Korean church with an English speaking ministry. Currently, we are trying to build our English speaking ministry. We are located in an area with approximately 10 condominium buildings with potential outreach to about 10,000 residents within five minute walking distance...English language skillsFull timePart timeDay shift$80 per hour
...of the end-to-end ML lifecycle: feature engineering, training, evaluation, deployment, monitoring, and governance. Demonstrated ability... ...an updated resume and ensure the required skills you are able to speak to for this position are included. At times, CorGTA or its client...Contract workRemote work$116.79k - $141.96k per year
...participates in technical research, analyzes data, evaluates findings, identifies significant issues,... ...Manager in undertaking the technical evaluation and assessment of current development... ...communication, presentation, and public speaking skills. ~ Demonstrated presentation,...Long term contractPermanent employmentFull timeTemporary workInternshipWork at officeLocal areaFlexible hoursWeekend workAfternoon shift$80.6k - $145k per year
...preferably in a clinical trial environment. • Excellent written and verbal communication skills. • Ability to read, write, speak and understand English. At Syneos Health, we believe in providing an environment and culture in which Our People can thrive, develop and...English language skillsContract workFlexible hours$45k - $48k per year
...application status through clear and timely communication. Process and evaluate undergraduate application files. Notify the applicant of... ...to conduct data analysis Excellent communication and public speaking skills with considerable experience speaking to audiences of all...Work at officeWeekend workAfternoon shift- ...leadership and communication skills. *Be flexible with their schedule. Working primarily weekends, as business levels require. *Speak the English language fluently. French is an asset. *Great guest service skills. *Computer skills. *Competent in cash handling. *Applicants must...English language skillsMinimum wageSummer workSeasonal workWork from homeFlexible hoursShift workRotating shiftWeekend work
$37 per hour
...Work Term: Permanent Work Language: English Hours: 32 to 36 hours per week Education: Secondary (high) school graduation certificate... ...of food, ingredients, alcohol, kitchen and cleaning supplies Evaluate daily operations Modify food preparation methods and menu...English language skillsPermanent employmentRelocationFlexible hoursDominos Pizza
Ontario7 days ago$52k - $60k per year
...International Programs, the Program Analyst provides monitoring and evaluation support, training, and guidance to ERDO program partners and... ...programs and online communication tools Strong written and oral English communication skills Exceptional organization skills and...English language skillsFull timeRemote workFlexible hours$64k - $72k per year
...on-going programs. Carry out data collection, analysis, and evaluations to assess program effectiveness and inform future programming.... ...Understand results-based management Strong written and oral English communication skills High-level proficiency with Microsoft suite...English language skillsFull timeRemote workFlexible hours- ...related to knowledge management. ~ May integrate Web sites with other computer applications along with converting written, graphical, audio and video components to compatible web formats by using software design to facilitate the creation of web and multimedia content....AudioFull timeLong distanceMonday to friday
- ...CLBC) is seeking a full-time Cantonese Pastor for our Cantonese-speaking congregation. As a small, family-oriented church, we are looking... ...candidate will be a collaborative leader who works closely with our English Ministry to foster a unified, multi-generational church body....English language skillsFull time
- ...Participates in on-going review of service delivery process and evaluation. Attends educational in-services that are deemed appropriate... ...including a vulnerable sector screen is required. Ability to speak French is an asset in French designated areas. Must be able to...Casual workLive outWork from home
- ...- New Employment Status: Temporary Language Requirement: English Essential Number of Vacancies 5 Salary: $23.81 Job Closing... ...The availability to be on-call The ability to read, write and speak English and/or French These help, too! Experience in...English language skillsPermanent employmentTemporary workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to English-Speaking JSON & Coders for Audio Evaluations. Be the first to apply!
Related searches