Remote ML Annotator: Live AI Conversation Evaluator
Scale AI
Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media and rate conversations with AI voice models. You will compare image/video outputs, judge adherence to prompts, and write precise explanations of any issues, all on your own schedule from anywhere.
Applicants should have strong English, be comfortable with live conversations, and be able to provide concise reviews. This is a freelance, 1099 role with weekly payments via PayPal/AirTM/ACH.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote ML Annotator: Live AI Conversation Evaluator in Toronto, ON vacancy
- ...Engineering Manager, AI Conversation Platform Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions... ...ll do Responsibilities Driving an ambitious vision for AI/ML that benefits our users Setting the technical & process...Suggested
$20 - $160 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Summers , and Jack Dorsey . Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$...Remote jobContract workSummer work- ...through world-class networks, AI-powered solutions, and digital... ...experiences that elevate how people live, work, and play every day.... ...Summary Bell is seeking a Conversational AI Developer to join an... ...., ADK, MCP, A2A) as the team evaluates them. Test and troubleshoot...SuggestedFull timeInternshipWork at office3 days per week
$154k - $199.5k per year
...Description: We are looking for an AI Platform Product Engineer who... ...through hands-on training, live demos and reusable learning... ...clear task specification, an evaluation they designed, and a failure they... .... Through regular development conversations, training programs, and a...SuggestedManual laborWork at officeWork from home$100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Clinical Mental Health Expert — AI Conversation Evaluation Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities...Remote jobContract workSummer work- Introduction At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make...Full timeInternship
$15 - $20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract... ...Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role...Remote jobContract workSummer work- ...prototypes into production-ready services. Hands-on experience with statistics and machine learning. Comfortable working with the Python ML stack: Pandas, Numpy, scikit-learn, XGBoost, PyTorch, etc. Proficient with development tools such as Git, Docker, SQL, Bash, and FastAPI...Remote workContract work
$64k - $106k per year
...Design and deliver offline evaluation frameworks with explicit success... ...shuffling. Design and operate our ML platform layer — feature store,... ...Design and implement agentic AI solutions that automate model... ...life in Canada better through living and working our Core Values: we...InternshipWork at office$21 - $27 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: AI Session Annotator (French) Type: Contract... ...–$27/hour Location: Remote Role Responsibilities... ...use of spatial language. Evaluate if the assistant provided timely...Remote jobContract workSummer workImmediate start$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $150/hour Location: Remote Commitment: 40 hours/week Role... ...well-structured reference solutions. Evaluate AI-written code , tests, and grading rubrics...Remote jobContract workSummer workWeekday work$120 - $180 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$180/hour Location: Remote Role Responsibilities Design... ...collaborating with AI coding agents to evaluate success and failure. Apply consistent...Remote jobContract workSummer workusd180k - usd247.5k per year
...based embedding retrieval serving live traffic, LLMs powering query... ...~3+ years building production ML systems, with meaningful time in... ...uses Artificial Intelligence (AI) to screen and select applicants... ...will have the flexibility to work remotely up to 4 weeks per year....Remote workInternshipWork at officeLocal areaWork from homeMonday to fridayFlexible hours3 days per week- ...Researcher specializing in Generative AI Models. In this role, you will... ...validating models. Model Evaluation and Tuning: Conduct thorough... ...Decision Making, Machine Learning (ML), Natural Language Processing (... ...At RBC, we are guided by living shared values of Client First,...
- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...EHR vignettes for a medical AI evaluation project. General and internal...Remote workPart timeFor contractorsFlexible hours
usd180k - usd247.5k per year
...Compass — Faire’s user facing AI bet within the Discovery Pillar... ...behalf. As a Senior Applied AI/ML Scientist on the Compass team,... ...agent quality through data, evaluation, and modeling, while shipping... ...will have the flexibility to work remotely up to 4 weeks per year....Remote workInternshipWork at officeLocal areaImmediate startWork from homeMonday to fridayFlexible hours3 days per week$16 - $22 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...$16–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents to identify... ...Experience in Adversarial ML : jailbreak datasets, prompt injection...Remote jobContract workSummer work$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...datasets with SMEs, coordinate evaluations, and design evaluation schemes, including... ...flexibility, work-life balance, and more. We live by our values: Obsess over our...RemplacementFull timeWork at officeLocal areaFlexible hours$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$154k - $199.5k per year
...secure, scalable Azure and Google Cloud AI/ML capabilities across the enterprise to solve... ...observability. Lead architectural conversations across Azure and Google Cloud, balancing... ...shield controls, MLOps/LLMOps pipelines, and evaluation tooling. Lead code review and set...Work from home$30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct... ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations...Remote workDaily paidFull timeContract workSummer workFlexible hours$30 per hour
...developers and enterprises who are building AI systems to power magical experiences like... ...BYOD ? - Bring Your Own Device (laptop). Remote work within Canada or the US is permitted.... ...attention to detail. Preference-Based Tasks: Evaluate and complete tasks, assessing which...Remote workHourly payFull timeContract workPart timeFor contractorsWork at officeFlexible hours$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win,...Full timeInternshipWork at officeLocal areaFlexible hours$130k - $150k per year
...S'more about the team Conversions Tech empowers our meal brands to achieve... ...frameworks, and use AI powered tools like Cursor, Figma... ...personal and life needs. Offering remote work flexibility, along with the... ...to help us process and evaluate applications more efficiently....Remote workCasual workManual laborWork at officeWork from homeFlexible hours2 days per week3 days per week$39 per hour
...technical talent with leading AI research labs. Headquartered in... ...$39/hour Location: Remote Duration: Up to 6 months... ...Role Responsibilities Evaluate AI model output lyrics ,... ...form Complete a 25-minute conversational interview on your background,...Remote jobContract workSummer workImmediate start$16 - $22 per hour
...and technical talent with leading AI research labs. Headquartered in... ...$16–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents. Conduct jailbreaks... ...Experience in Adversarial ML : jailbreak datasets, prompt...Remote jobContract workSummer workFlexible hours$85 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: ML Engineer (Coding Agent Experience... ...$85/hour Location: Remote Role Responsibilities... ...coding agents to complete and evaluate complex machine learning and...Remote jobContract workSummer work$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...accurate application of structured evaluation guidelines. Work...Remote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote ML Annotator: Live AI Conversation Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON