Context Elicitation & Conversation Evaluation Specialists - USA, Canada, Western Europe
Turing
Review AI conversations to identify context gaps and improve clarity.
About Turing:
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.
Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role overview :
We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research.
SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.
Job Responsibilities:
- Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
- Identify missing context and recommend relevant follow-up questions.
- Evaluate whether additional information would have changed the AI's recommendations.
- Distinguish between critical ("load-bearing") and non-essential information.
- Conduct qualitative reviews and document findings using structured evaluation guidelines.
- Collaborate with research teams to ensure consistent, high-quality assessments..
Required Qualification:
- Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas:
Licensed Social Work
- MSW or equivalent graduate-level qualification in Social Work.
- LCSW, LICSW, LMSW, or equivalent applicable social work license/credential.
- Experience with client assessment, case review, interviewing, counseling, or related social-work practice.
Counseling, Therapy, or Psychology
- MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or
- PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
- Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work.
Qualitative Research, HCI, or Communication
- MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline.
- Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.
- Relevant backgrounds may include Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology, or related disciplines.
Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields
- Relevant professional qualification, credential, or demonstrated subject-matter expertise.
- Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work.
- Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance. Must be based in the USA, Canada or Western Europe
Preferred experience:
- Experience eliciting relevant context when clients initially provide incomplete information
- Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors
- Qualitative coding or structured case review
- Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative
- Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information
gathering Project Details : - Project duration - 3 weeks (short term project)
- Project type - Pay-per-task (PPT)
- AHT - 75 minutes (approx.)
- Engagement - Full time
- Estimated project start date - 1st October (estimated)
Skills: Business Analysis
- ...What You'll Do You'll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work... ..., completeness, and professional quality. Develop clear evaluation rubrics and scoring criteria, identifying meaningful errors and...SuggestedContract work
- © 2026 Smart Ecosystems. All rights reserved.SuggestedContract work
$40 per hour
...Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview...SuggestedPart timeRemote workFlexible hours- ...KMS Technology group, is growing its presence across Europe — and we're looking for a Marketing Specialist to help lead that growth. You'll join our Inbound... ...while adapting messaging, channels, and timing to local context. You'll partner with the US campaigns team to bring...SuggestedPermanent employmentFull timeLocal areaRemote workFlexible hoursShift work
$13 per hour
...Belize | Bolivia + 15 more Help evaluate how an AI assistant uses... ...project is for people based in Canada, outside Quebec, who can review... ...and appropriate use of context. • Compare responses, identify... ...for consistent, confidential evaluation work. Important account-access...SuggestedHourly payContract workFor contractorsRemote work- ...Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply their clinical...Temporary workPart timeRemote work
$85 - $110 per hour
...Location: United States | Canada + 9 more **This role is open to candidates in US, Europe, Canada and LATAM** About the... ...automates patient engagement through conversational workflows (SMS and voice). At... ...outputs Chatbot Architecture Context ● 4-phase workflow: analysis,...Long term contractFull timeContract workRemote work$129.2k - $174.8k per year
...the knowledge layer that connects content, context, and action. As AI moves from assistants... ...architecture, retrieval and grounding, evaluation, semantic structure, permissions requirements... ..., Melanie Rosenwasser. Compensation Canada Pay Range $129,200—$174,800 CAD...Full time- ...you have a passion for the past? At TELUS Digital , we need specialists with a background in History to help AI understand time, culture... ...invention existed before it was actually created. Content Evaluation: Help the AI write better, clearer historical stories for students...Part time
- ...About The Role We’re hiring AI Training Specialists – French Language & Cultural Context to help train and refine AI models that understand and communicate effectively in French. Your role involves evaluating AI outputs, identifying linguistic errors, improving regional...Contract work
usd15 per hour
...want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from... ...part-time job: Language: English and French proficiency. Location: Canada (Work from Home). Schedule: E. g. 8-20 h/week. Avg. 15 h/weekly....Weekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours$78k - $85k per year
...Dozuki value to prospect needs through capability demonstrations, evaluations and target-specific initiatives Coordinate and work with the... ...must be authorized to work for ANY employer in the U.S. or Canada. We are unable to sponsor or take over sponsorship of an employment...Remote jobFull timeWork visaFlexible hours- ...Fullstack Engineer to join the Customer Context team. You’ll help build and scale the... ...fully remote and can be based in the US or Canada. What You'll Do Take deep ownership... ...code (eg, Terraform). You are comfortable evaluating and applying your infra changes. ~...Long term contractFull timeInternshipRemote workWork from homeFlexible hours
- ...partner is looking for a Head of Funnel Conversion (CRO) based in Canada. We are seeking a highly analytical,... ...team of country-specific conversion specialists, engineers, and designers to improve... ...and Technology Optimization: Evaluate and improve experimentation, analytics...Full timeLocal areaRemote work
- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Contract work
- ...Our partner is looking for a Funnel Conversion (CRO) Lead based in Canada. This is an exciting opportunity for... ...performance across customer segments, evaluate test outcomes, and translate... ...stakeholders, and other conversion specialists to share insights, support international...Full timeLocal areaRemote work
$140k - $180k per year
...summaries and authentication context. Build simulation and... ...experience in Solutions Engineering, Conversational AI, or Technical Product... .... ~ Experience building evaluations for non-deterministic systems... ..., contact-center systems, conversation design, UX writing, or regulated...Full timeInternshipFlexible hours- ...-code journeys), Sierra simulations and conversation analytics, GraphQL and REST APIs (as journey... ...with accurate summaries and auth context • Testing: Build simulation and regression... ...where each one fails • Experience building evaluations for non-deterministic systems: test sets...Internship
- ...partner company, who manages all applications and next steps. Our partner is looking for a Senior Fullstack Engineer, Customer Context based in Canada. As a Senior Fullstack Engineer, you’ll help build the foundational services, APIs, and data pipelines powering an AI-driven...Long term contractFull timeRemote work
- ...applications and next steps. Our partner is looking for a Portuguese Audio Evaluations Specialist – Freelance AI Trainer Project based in Canada. Contribute to the development of advanced conversational AI by evaluating audio-based models in realistic customer support...Hourly payFull timeFor contractorsFreelanceRemote workFlexible hours
- ...to own our experimentation process end-to-end—from identifying conversion leaks and building data-grounded hypotheses to prioritizing tests... ...initiatives based on business impact. ~ Comfortable working beyond pure CRO tools — funnels, acquisition context, and creative logic....Permanent employmentFull timeRemote work
- ...dynamic and engaging company culture that celebrates creativity, collaboration, and inclusion. We are hiring a Product Solutions Specialist to serve as the operational extension of Product Management, leading customer implementation and customization projects from...Long term contractRemote work
- ...Job Application for French Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial... ...through simulated interactions, audit conversational AI outputs, and generate clean, reliable... ...structured data within a support context. Representative Dataset Generation:...Hourly payPart timeFor contractorsFreelanceRemote work
$60k - $80k per year
...in KLAS recognition, ranking #1 for PACS Europe UK/Ireland in the 2026 Best in KLAS: Global... ...Job Description The Project Specialist II leads small to medium healthcare IT implementation... .../yr CAD within any geographic market in Canada. Pay may vary depending on job-related...Full timeLocal areaRemote work- ...a global community of experts to evaluate, challenge and improve advanced AI... ...Healthcare, Finance, Education and other specialist disciplines. You do not need a... ...LLM & NLP AI-generated text and conversations Language, meaning, context and reasoning Hallucinations and...Part time
- ...to own our experimentation process end-to-end—from identifying conversion leaks and building data-grounded hypotheses to prioritizing tests... ...initiatives based on business impact. ~ Comfortable working beyond pure CRO tools — funnels, acquisition context, and creative logic....Permanent employmentFull timeRemote work
- ...Record a remote conversation with another adult that naturally mixes English and your native language. Check language and audio requirements... ...· Type: Data Collection · Pay: $75 · Location: Bahrain · Canada Data Collection Bilingual Code-Switching Conversation Contributor...Part timeRemote work
usd15 per hour
...AI Conversation Specialist - (Jizan) Saudi Arabic Riyadh RWS – TrainAI / Temporary/Contract / Remote apply for this job We are... ...financial analysis, business reporting, research/policy evaluation, and data-driven decision support . Conduct conversations...Extra incomeTemporary workPart timeFreelanceImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Evaluate and refine AI-generated code for efficiency and reliability. About Us Based... ...communication skills for clear, structured evaluation rationales. Engagement Details... ...Location: candidates must be based out of US, Canada or WEU countries (Austria, Belgium, France...Part timeFor contractorsFlexible hours
- ...Client Conversion Specialist We are seeking a dedicated Client Conversion Specialist to join our team and play a crucial role in converting leads into active trading accounts. As a Client Conversion Specialist, you will contact and follow up with new and existing leads through...Permanent employmentFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Context Elicitation & Conversation Evaluation Specialists - USA, Canada, Western Europe. Be the first to apply!
- credit specialist Remote
- workforce specialist Remote
- lead generation specialist Remote
- personal computer specialist Remote
- customs import specialist Remote
- spécialiste technique Remote
- reimbursement specialist Remote
- reading specialist Remote
- learning specialist Remote
- disability management specialist Remote
