Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Context Elicitation & Conversation Evaluation Specialists - USA, Canada, Western Europe

Part-time

Turing

Review AI conversations to identify context gaps and improve clarity.

About Turing:
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role overview :
We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research.

SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.

Job Responsibilities:

  • Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
  • Identify missing context and recommend relevant follow-up questions.
  • Evaluate whether additional information would have changed the AI's recommendations.
  • Distinguish between critical ("load-bearing") and non-essential information.
  • Conduct qualitative reviews and document findings using structured evaluation guidelines.
  • Collaborate with research teams to ensure consistent, high-quality assessments..

Required Qualification:

  • Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas:

Licensed Social Work

  • MSW or equivalent graduate-level qualification in Social Work.
  • LCSW, LICSW, LMSW, or equivalent applicable social work license/credential.
  • Experience with client assessment, case review, interviewing, counseling, or related social-work practice.

Counseling, Therapy, or Psychology

  • MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or
  • PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
  • Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work.

Qualitative Research, HCI, or Communication

  • MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline.
  • Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.
  • Relevant backgrounds may include Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology, or related disciplines.

Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields

  • Relevant professional qualification, credential, or demonstrated subject-matter expertise.
  • Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work.
  • Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance.

    Must be based in the USA, Canada or Western Europe

Preferred experience:

  • Experience eliciting relevant context when clients initially provide incomplete information
  • Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors
  • Qualitative coding or structured case review
  • Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative
  • Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information
    gathering

    Project Details :
  • Project duration - 3 weeks (short term project)
  • Project type - Pay-per-task (PPT)
  • AHT - 75 minutes (approx.)
  • Engagement - Full time
  • Estimated project start date - 1st October (estimated)

Skills: Business Analysis

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Context Elicitation & Conversation Evaluation Specialists - USA, Canada, Western Europe in Remote vacancy
  •  ...What You'll Do You'll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work...  ..., completeness, and professional quality. Develop clear evaluation rubrics and scoring criteria, identifying meaningful errors and... 
    Suggested
    Contract work

    Rise Data Labs

    Remote
    12 days ago
  • © 2026 Smart Ecosystems. All rights reserved.
    Suggested
    Contract work

    Outlier AI

    Remote
    12 days ago
  • $40 per hour

     ...Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview... 
    Suggested
    Part time
    Remote work
    Flexible hours

    Handshake

    Remote
    1 day ago
  •  ...KMS Technology group, is growing its presence across Europe — and we're looking for a Marketing Specialist to help lead that growth. You'll join our Inbound...  ...while adapting messaging, channels, and timing to local context. You'll partner with the US campaigns team to bring... 
    Suggested
    Permanent employment
    Full time
    Local area
    Remote work
    Flexible hours
    Shift work

    Addepto

    Remote
    a month ago
  • $13 per hour

     ...Belize | Bolivia + 15 more Help evaluate how an AI assistant uses...  ...project is for people based in Canada, outside Quebec, who can review...  ...and appropriate use of context. • Compare responses, identify...  ...for consistent, confidential evaluation work. Important account-access... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Remote work

    Braintrust

    Remote
    12 days ago
  •  ...Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply their clinical... 
    Temporary work
    Part time
    Remote work

    Mercor

    Remote
    12 days ago
  • $85 - $110 per hour

     ...Location: United States | Canada + 9 more **This role is open to candidates in US, Europe, Canada and LATAM** About the...  ...automates patient engagement through conversational workflows (SMS and voice). At...  ...outputs Chatbot Architecture Context ● 4-phase workflow: analysis,... 
    Long term contract
    Full time
    Contract work
    Remote work

    Braintrust

    Remote
    1 day ago
  • $129.2k - $174.8k per year

     ...the knowledge layer that connects content, context, and action. As AI moves from assistants...  ...architecture, retrieval and grounding, evaluation, semantic structure, permissions requirements...  ..., Melanie Rosenwasser. Compensation Canada Pay Range $129,200—$174,800 CAD... 
    Full time

    Dropbox

    Remote
    7 days ago
  •  ...you have a passion for the past? At TELUS Digital , we need specialists with a background in History to help AI understand time, culture...  ...invention existed before it was actually created. Content Evaluation: Help the AI write better, clearer historical stories for students... 
    Part time

    TELUS International

    Remote
    13 days ago
  •  ...About The Role We’re hiring AI Training Specialists – French Language & Cultural Context to help train and refine AI models that understand and communicate effectively in French. Your role involves evaluating AI outputs, identifying linguistic errors, improving regional... 
    Contract work

    Cognito AI

    Remote
    12 days ago
  • usd15 per hour

     ...want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from...  ...part-time job: Language: English and French proficiency. Location: Canada (Work from Home). Schedule: E. g. 8-20 h/week. Avg. 15 h/weekly.... 
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Remote work
    Work from home
    Home office
    Flexible hours

    Rws

    Remote
    13 days ago
  • $78k - $85k per year

     ...Dozuki value to prospect needs through capability demonstrations, evaluations and target-specific initiatives Coordinate and work with the...  ...must be authorized to work for ANY employer in the U.S. or Canada. We are unable to sponsor or take over sponsorship of an employment... 
    Remote job
    Full time
    Work visa
    Flexible hours

    Dozuki

    Remote
    14 days ago
  •  ...Fullstack Engineer to join the Customer Context team. You’ll help build and scale the...  ...fully remote and can be based in the US or Canada. What You'll Do Take deep ownership...  ...code (eg, Terraform). You are comfortable evaluating and applying your infra changes. ~... 
    Long term contract
    Full time
    Internship
    Remote work
    Work from home
    Flexible hours

    Postscript

    Remote
    7 days ago
  •  ...partner is looking for a Head of Funnel Conversion (CRO) based in Canada. We are seeking a highly analytical,...  ...team of country-specific conversion specialists, engineers, and designers to improve...  ...and Technology Optimization: Evaluate and improve experimentation, analytics... 
    Full time
    Local area
    Remote work

    Jobgether

    Remote
    1 day ago
  •  ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements... 
    Contract work

    Rise Data Labs

    Remote
    12 days ago
  •  ...Our partner is looking for a Funnel Conversion (CRO) Lead based in Canada. This is an exciting opportunity for...  ...performance across customer segments, evaluate test outcomes, and translate...  ...stakeholders, and other conversion specialists to share insights, support international... 
    Full time
    Local area
    Remote work

    Jobgether

    Remote
    1 day ago
  • $140k - $180k per year

     ...summaries and authentication context. Build simulation and...  ...experience in Solutions Engineering, Conversational AI, or Technical Product...  .... ~ Experience building evaluations for non-deterministic systems...  ..., contact-center systems, conversation design, UX writing, or regulated... 
    Full time
    Internship
    Flexible hours

    Upgrade

    Remote
    1 day ago
  •  ...-code journeys), Sierra simulations and conversation analytics, GraphQL and REST APIs (as journey...  ...with accurate summaries and auth context • Testing: Build simulation and regression...  ...where each one fails • Experience building evaluations for non-deterministic systems: test sets... 
    Internship

    Upgrade

    Remote
    1 day ago
  •  ...partner company, who manages all applications and next steps. Our partner is looking for a Senior Fullstack Engineer, Customer Context based in Canada. As a Senior Fullstack Engineer, you’ll help build the foundational services, APIs, and data pipelines powering an AI-driven... 
    Long term contract
    Full time
    Remote work

    Jobgether

    Remote
    8 days ago
  •  ...applications and next steps. Our partner is looking for a Portuguese Audio Evaluations Specialist – Freelance AI Trainer Project based in Canada. Contribute to the development of advanced conversational AI by evaluating audio-based models in realistic customer support... 
    Hourly pay
    Full time
    For contractors
    Freelance
    Remote work
    Flexible hours

    Jobgether

    Remote
    2 days ago
  •  ...to own our experimentation process end-to-end—from identifying conversion leaks and building data-grounded hypotheses to prioritizing tests...  ...initiatives based on business impact. ~ Comfortable working beyond pure CRO tools — funnels, acquisition context, and creative logic.... 
    Permanent employment
    Full time
    Remote work

    Trafilea

    Remote
    2 days ago
  •  ...dynamic and engaging company culture that celebrates creativity, collaboration, and inclusion. We are hiring a Product Solutions Specialist to serve as the operational extension of Product Management, leading customer implementation and customization projects from... 
    Long term contract
    Remote work

    LimeFlight

    Remote
    a month ago
  •  ...Job Application for French Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial...  ...through simulated interactions, audit conversational AI outputs, and generate clean, reliable...  ...structured data within a support context. Representative Dataset Generation:... 
    Hourly pay
    Part time
    For contractors
    Freelance
    Remote work

    Invisible Technologies

    Remote
    12 days ago
  • $60k - $80k per year

     ...in KLAS recognition, ranking #1 for PACS Europe UK/Ireland in the 2026 Best in KLAS: Global...  ...Job Description The Project Specialist II leads small to medium healthcare IT implementation...  .../yr CAD within any geographic market in Canada. Pay may vary depending on job-related... 
    Full time
    Local area
    Remote work

    Intelerad

    Remote
    20 days ago
  •  ...a global community of experts to evaluate, challenge and improve advanced AI...  ...Healthcare, Finance, Education and other specialist disciplines. You do not need a...  ...LLM & NLP AI-generated text and conversations Language, meaning, context and reasoning Hallucinations and... 
    Part time

    TELUS International

    Remote
    13 days ago
  •  ...to own our experimentation process end-to-end—from identifying conversion leaks and building data-grounded hypotheses to prioritizing tests...  ...initiatives based on business impact. ~ Comfortable working beyond pure CRO tools — funnels, acquisition context, and creative logic.... 
    Permanent employment
    Full time
    Remote work

    Trafilea

    Remote
    4 hours ago
  •  ...Record a remote conversation with another adult that naturally mixes English and your native language. Check language and audio requirements...  ...· Type: Data Collection · Pay: $75 · Location: Bahrain · Canada Data Collection Bilingual Code-Switching Conversation Contributor... 
    Part time
    Remote work

    OneForma

    Remote
    13 days ago
  • usd15 per hour

     ...AI Conversation Specialist - (Jizan) Saudi Arabic Riyadh RWS – TrainAI / Temporary/Contract / Remote apply for this job We are...  ...financial analysis, business reporting, research/policy evaluation, and data-driven decision support . Conduct conversations... 
    Extra income
    Temporary work
    Part time
    Freelance
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    RWS

    Remote
    13 days ago
  •  ...Evaluate and refine AI-generated code for efficiency and reliability. About Us Based...  ...communication skills for clear, structured evaluation rationales. Engagement Details...  ...Location: candidates must be based out of US, Canada or WEU countries (Austria, Belgium, France... 
    Part time
    For contractors
    Flexible hours

    Turing

    Remote
    12 days ago
  •  ...Client Conversion Specialist We are seeking a dedicated Client Conversion Specialist to join our team and play a crucial role in converting leads into active trading accounts. As a Client Conversion Specialist, you will contact and follow up with new and existing leads through... 
    Permanent employment
    Full time

    DB Financial

    Remote
    27 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Context Elicitation & Conversation Evaluation Specialists - USA, Canada, Western Europe. Be the first to apply!