Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Data Science Expert: AI Evaluation & Experimentation

mercor

Mercor is seeking a Data Science Expert for a remote contract role. You will design precise grading criteria for real-world data science deliverables and score AI-generated and human work with detailed justifications.

You will apply evidence-based judgment to ensure scores are reproducible, incorporate feedback from senior reviewers, and work independently to meet deadlines while helping improve AI model performance.

#J-18808-Ljbffr
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Remote Data Science Expert: AI Evaluation & Experimentation in Ottawa, ON vacancy
  •  ...(~15 hours/week) Location: Remote Job Summary We are seeking...  ...Engineers to support an AI training project by creating reinforcement...  ...learning environments that evaluate AI models on complex software...  ...of algorithms and data structures . Experience with... 
    Remote job
    For contractors

    YO AI Labs

    Ottawa, ON
    a month ago
  • $70 per hour

     ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is...  ...evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our... 
    Suggested
    Hourly pay
    Permanent employment
    Part time
    10 hours per week

    Mindrift

    Ottawa, ON
    3 days ago
  • $70k - $80k per year

     ...Position: Monitoring and Evaluation Officer Location: Remote with Hybrid Option (Ottawa) Salary Range: $70...  ...they will contribute to program design, data analysis, and the development of...  ...short-term contracts from the roster of experts to fulfill these organizational and program... 
    Remote work
    Temporary work
    Local area
    Flexible hours

    Codengo

    Ottawa, ON
    a month ago
  •  ...Company Description Assent is the leading AI native platform for supply chain...  ...distributors around the world. Built and backed by experts who have led global compliance programs, our...  ...expertise, and the world’s largest supply chain data network to help organizations reduce risk,... 
    Suggested
    Long term contract
    Full time
    Flexible hours

    Assent Inc

    Ottawa, ON
    a month ago
  • $120k - $240k per year

     ...Job Description: #Cosmos #Solana #DataScience About the Role: We're looking for a Data Science Associate to join our team, supporting Research, Trading, Risk, and Operations functions in the blockchain space. You'll work closely with a small team of blockchain engineers... 
    Suggested
    Full time
    Relocation

    Web3Leaders

    Ottawa, ON
    14 days ago
  •  ...Financial Systems & Accounting Expert Role Type: Contractor Location: Remote, Worldwide Schedule: Flexible Role Overview micro1...  ...accounting judgment and financial systems expertise to evaluate and improve AI-generated outputs and training data. Prior... 
    Remote job
    For contractors
    Immediate start
    Worldwide
    Flexible hours

    YO AI Labs

    Ottawa, ON
    25 days ago
  • $40k - $80k per year

     ...The Telesat LEO Lightspeed Data Management Specialist will report...  ...data management subject matter expert, coaching, supporting and guiding...  ...’s Degree, Library Information Science/College Degree in Information and...  ...use artificial intelligence (AI) tools to support parts of the... 
    Full time
    For contractors
    Internship
    Work at office
    Worldwide
    Flexible hours

    Telesat Corporation

    Ottawa, ON
    15 days ago
  • $96.56k - $128.74k per year

     ...through trade. Position: Senior AI Developer Employment Type:...  ...financial solutions and expert insights to help businesses explore...  ...technology target state, target data model and technology operations...  ...related field such as Computer Science, Engineering or relevant field.... 
    Permanent employment
    Full time
    Summer work
    Work at office
    Relocation package
    3 days per week

    Export Development Canada

    Ottawa, ON
    9 days ago
  •  ...Generalist Job Type: Contractor Location: Remote Role Overview We are looking for...  ...analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information across different topics... 
    Remote job
    For contractors

    YO AI Labs

    Ottawa, ON
    27 days ago
  •  ...Role Type: Contractor Location: Remote, Worldwide Schedule: Flexible...  ...your professional design expertise to evaluate and improve AI-generated creative outputs and contribute...  ...training. Prior paid experience in human-data work for AI models is required. Experience... 
    Remote job
    For contractors
    Worldwide
    Flexible hours

    YO AI Labs

    Ottawa, ON
    25 days ago
  •  ...June 26 for my 12-month-old daughter. Hours would be Monday to Friday, 9 AM to 4 PM. We are located in Ottawa, Ontario, near the Experimental Farm. Care would be provided at our house, but we are looking for a live-out nanny. Please visit to view full details and to apply... 
    Temporary work
    Live out
    Monday to friday

    CanadianNanny.ca

    Ottawa, ON
    16 days ago
  •  ...Staff Software Engineer, Data Level: P4 Location: Remote, Canada Reports To: Sean Yang, Director of Engineering...  ..., supported by a degree in Computer Science, Engineering, or a related technology...  ...uses artificial intelligence (AI) to screen, assess, and/or select... 
    Remote job
    Permanent employment
    Full time
    Immediate start

    Sol Ink

    Ottawa, ON
    17 days ago
  • $96.56k - $128.74k per year

     ...better through trade. Position: AI Administrator, M365 & Copilot...  ...financial solutions and expert insights to help businesses explore...  ...technology target state, target data model and technology operations...  ...degree in Computer Science, Management Information Systems... 
    Permanent employment
    Full time
    Summer work
    Work at office
    Relocation package
    3 days per week

    Export Development Canada

    Ottawa, ON
    12 days ago
  •  ...Role Type: Contractor Location: Remote micro1 is seeking Business Analysts,...  ...analysis, research, and operational reasoning for AI training. No prior AI experience is required...  ...and stakeholder insights. Analyze data using Excel, SQL, or similar tools. Develop... 
    Remote job
    For contractors

    YO AI Labs

    Ottawa, ON
    26 days ago
  •  ...opportunity We are seeking a Senior Manager/Data & AI Architect  for o ur AI & Data practice...  ..., emerging technologies, sharing & experimentation across the org through mentoring,...  ...must have Bachelor’s degree in computer science, mathematics, data science, informatics,... 
    Long term contract
    Weekend work

    Ernst & Young

    Ottawa, ON
    10 days ago
  • $80k - $95k per year

     ...Job Summary:   The Project Manager – Building Science  serves to manage building envelop and restorations projects from initial stage...  ...Conduct condition survey assessments through the testing and evaluation of building envelope and concrete systems for residential, commercial... 
    Full time
    Contract work
    Internship
    Local area

    Salas O'Brien

    Ottawa, ON
    more than 2 months ago
  •  ...AI Agent Power User Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are...  ...training project focused on evaluating and improving AI assistants in...  ...Experience creating or applying evaluation rubrics, QA scorecards,... 
    Remote job
    Contract work
    For contractors

    YO AI Labs

    Ottawa, ON
    15 days ago
  • usd15 per hour

     ...Overview: Are you a web-savvy, search expert with a talent for finding...  ...influence the future of global AI search? If so, we want you on...  ...behalf of RWS, you will test and evaluate how our clients’ search engine...  ...a crucial part in enhancing AI data which will be used to improve the... 
    Remote work
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    18 days ago
  • $99.38k per year

     ...for a tenure-track Canada Impact+ Emerging Leader position in Experimental Biophotonics, aligned with the Government of Canada strategic...  ...Health, Environment, and Quantum Technologies in the Faculty of Science, as part of the Eddie Goldenberg Research Chairs of Canada Program... 
    Long term contract
    Full time
    Work at office
    Immediate start
    Relocation

    University of Ottawa, Ontario CANADA

    Ottawa, ON
    1 day ago
  • $88.4k - $104k per year

     ...With built-in research expertise and AI-powered technology, it’s like having a team of expert researchers at your fingertips....  ...channel we touch. We're also a data company with more than 25 years of...  ..., product marketing, and our data science team. What you’ll be working... 
    Full time
    Work at office
    Flexible hours
    1 day per week

    Surveymonkey

    Ottawa, ON
    more than 2 months ago
  •  ...Job Type: Contractor Location: Remote Work Schedule: Part-time/ Full Time...  ...and playbook development to review and evaluate AI-generated legal content. No prior AI...  ...-generated contract analysis and provide expert feedback. Develop playbooks, evaluation... 
    Remote job
    Full time
    Contract work
    Part time
    For contractors

    YO AI Labs

    Ottawa, ON
    a month ago
  • $118k per year

     ...Applied Research team is a group of data scientists and content specialists who are experts in leveraging machine learning,...  ...processing and generative AI models to develop solutions which...  ...whether it’s in product surface experimentation, metadata generation or model development... 
    Long term contract
    For contractors
    Local area
    Home office
    Flexible hours

    Scribd, Inc.

    Ottawa, ON
    16 days ago
  •  ...Audio Expert – Music Transcription & Polyphonic Analysis Role Type: Contractor Location: Global, Fully Remote Schedule: Flexible, ~15 hours/week Role Summary We are seeking...  ..., and Python skills to support an AI training project. Key Responsibilities... 
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    Ottawa, ON
    a month ago
  •  ...AI/ML Engineer Job Type: Full-Time Location: Remote Job Summary We are seeking an experienced AI/ML Engineer to build and deploy secure, scalable...  ...AI, and AWS Bedrock . Build robust ETL and data pipelines , metadata catalogs, and ontologies for AI... 
    Remote job
    Full time

    YO AI Labs

    Ottawa, ON
    a month ago
  •  ...Shakepay Inc. seeks a Senior Security Engineer to safeguard our infrastructure, products and customer data while advancing our AI-driven security platform. You will be a hands-on contributor across application, cloud, enterprise security and observability, partnering with... 
    Remote work

    Shakepay Inc.

    Ottawa, ON
    12 hours ago
  •  ...Hebrew Bilingual Expert Job Type: Contractor Location: Remote Job Overview We are seeking Hebrew Bilingual...  ...to an impactful language and AI training project focused on improving...  .... In this role, you will evaluate Hebrew audio content, assess linguistic... 
    Remote job
    For contractors

    YO AI Labs

    Ottawa, ON
    a month ago
  •  ...Role Type: Contractor Location: Remote Role Summary We are seeking experienced...  ...structure real-world creative assets for AI training. Scope of Work...  ...Adobe/Figma Production Flow Design Evaluation Strong written English and visual communication... 
    Remote job
    For contractors

    YO AI Labs

    Ottawa, ON
    a month ago
  •  ...Hardware Expert – CAD & Mechanical Design Role Type: Contractor Location: Global, Fully Remote Schedule: Flexible, ~15 hours/week Role Summary We are seeking skilled...  ...geometry experience to support an AI training project involving technical drawings... 
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    Ottawa, ON
    a month ago
  • $62.09k - $75.65k per year

     ...Ottawa, Ontario (Hybrid, 3-4 Days On-site) Reports to: Manager, Data & Donor Relations Status: Permanent, Full time Bargaining Unit...  ...qualifications. Please note that applications will be evaluated as they are received, and interviews may be conducted before the... 
    Permanent employment
    Full time
    For subcontractor
    Seasonal work
    Work at office
    Monday to friday
    3 days per week

    Cuso International

    Ottawa, ON
    3 days ago
  • $128k - $160k per year

     ...Description Title: Director IT & Data Transformation Employment...  ...with confidence and adopt AI responsibly. The Director plays...  ...Information Technology, Computer Science, Information Systems, or a related...  ...low-code AI tools; comfortable evaluating new tools for quality and risk... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Flexible hours
    2 days per week

    Nutrition International

    Ottawa, ON
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Data Science Expert: AI Evaluation & Experimentation. Be the first to apply!