Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Experimentation Analyst - AI Trainer

$40 - $60 per hour

Talantir

Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule.

We are looking for an experienced Experimentation Analyst - AI Trainer to help advance AI development. AI models are increasingly capable of performing complex analytical and scientific reasoning - but these systems still need practitioners with real-world quantitative experience to validate whether the outputs actually hold up in practice. That's where you come in.

As a member of DataAnnotation's team, you'll work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems, and providing feedback that directly shapes how these systems reason about data, models, and scientific problems. Whether your background is in data science, astrophysics, economics, biostatistics, operations research, or any other quantitative field, if you think rigorously about data and models, your skills are directly applicable here. Some team members fit this work alongside a full-time role, while others treat it as their primary focus.

Benefits

  • Fully remote: work from anywhere in the US, Canada, UK, Ireland, Australia, and New Zealand.
  • Flexible schedule: choose which projects you take on and when you work.
  • Competitive pay: projects are paid hourly, starting at $40+ USD per hour.
  • Impact: help shape the future of AI systems built to reason about data and analytics.

Responsibilities

  • Evaluate AI-generated quantitative work, including statistical analysis, predictive modeling, scientific reasoning, and data-driven insights, for technical accuracy and real-world validity.
  • Design and solve quantitative problems used to train and benchmark AI systems, spanning areas like forecasting, experimental analysis, optimization, and statistical inference.
  • Write clear technical explanations and well-documented analytical code.
  • Provide feedback that directly shapes the next generation of AI models built for quantitative reasoning.

Qualifications

  • 2+ years of hands-on experience in a quantitative role or research environment - such as data science, statistics, economics, finance, physics, biology, epidemiology, operations research, or any adjacent field.
  • Some coding experience required, with comfort writing and reviewing analytical code end-to-end.
  • Practical experience with statistical methods, predictive modeling, and experiment design (e.g. A/B testing, hypothesis testing, regression, classification, time-series forecasting).
  • Fluency in English (native or bilingual level) with strong writing skills.
  • A bachelor's degree in a quantitative field is preferred (Statistics, Computer Science, Mathematics, Engineering, or similar); a master's or PhD is a plus.
  • Relevant credentials are a plus (e.g. Kaggle Competition ranking, AWS/GCP ML certifications, or equivalent demonstrated expertise).

Additional Details

  • Job Type: Contract
  • Pay: $40.00-$60.00 per hour
  • Work Location: Remote

Payment is made via PayPal.

This job is only available to those in the US, Canada, UK, Ireland, Australia, and New Zealand.

#J-18808-Ljbffr
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Experimentation Analyst - AI Trainer in Toronto, ON vacancy
  • $45 per hour

     ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $124k - $186k per year

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building...  ...The Opportunity We're looking for an experienced AI Trainer and Optimization Analyst to take full ownership of our customer support agentic experiences... 
    Suggested
    Local area
    Worldwide

    Okta

    Toronto, ON
    1 day ago
  • $70k - $75k per year

     ...complex business challenges and transformation, increasingly using AI and emerging technologies to create practical business value....  ...early-career professional to join our Toronto team as a Business Analyst . We are looking for a different type of Business Analyst — someone... 
    Suggested
    Full time
    Internship

    Adaptovate

    Toronto, ON
    18 days ago
  • $105k - $115k per year

     ...Who We Are Konrad is an AI-driven digital consultancy and product-innovation firm...  ...people. About The Role As a Senior Data Analyst, you are an experienced analytics...  ...establish best practices across data modeling, experimentation, and reporting. You are curious,... 
    Suggested
    Full time
    Work from home
    Flexible hours

    Konrad Company

    Toronto, ON
    7 days ago
  •  ...About Behavox Behavox is a cloud-native AI company providing an integrated controls...  ...engineering culture is built around speed, experimentation, and technical excellence, following...  ...and Tokyo. About The Role The FP&A Analyst maintains and develops defined components... 
    Suggested
    Long term contract
    Full time
    Work at office
    Immediate start
    Worldwide

    Behavox

    Toronto, ON
    24 days ago
  • $100 per hour

     ...Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is project-based.... 
    Hourly pay
    Permanent employment
    Part time
    Freelance
    10 hours per week

    Mindrift

    Toronto, ON
    1 day ago
  • $100k - $125k per year

     ...Role At Clutch, we believe advances in AI are fundamentally changing how great...  ...days instead of months. As a Senior Data Analyst, you'll join our data team and take on some...  .... ~ Solid grounding in statistics and experimentation. ~ Hands-on experience with a BI tool,... 
    Permanent employment
    Full time
    3 days per week

    Clutch Technologies

    Toronto, ON
    23 days ago
  •  ...CoreFactor is searching for a Senior AI Engineer on a permanent/full-time basis....  ...agents and GenAI systems that CI's advisors, analysts, and operations teams actually rely on day...  ...reviews, championing best practices around experimentation, reproducibility, and responsible AI.... 
    Permanent employment
    Full time
    Work at office

    CoreFactor

    Toronto, ON
    25 days ago
  •  ...era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the...  ...thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler... 
    Full time
    Work at office
    Local area
    Worldwide

    Snowflake

    Toronto, ON
    11 days ago
  • $118.3k - $142k per year

     ...Zynga Poker is seeking a Principal Data Analyst to help drive decisions that impact millions...  ...that influence product direction Experimentation: Design, conduct, and analyze statistically...  ...in and contribute to the Analytics Org’s AI initiative, which is doing significant strides... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Zynga, Inc.

    Toronto, ON
    a month ago
  • $58k - $70k per year

     ...results-oriented new graduate to join our Finance team as a Financial Analyst with an Accounts Receivable focus. This is a unique cross-...  ...Existing vacancy Annual Compensation Range: $58,000–$70,000 CAD AI Use: As part of our interview process, selected candidates may be... 
    Full time

    Green House As

    Toronto, ON
    7 days ago
  • $140k - $160k per year

     ...worldwide. And we'd love for you to join us! About the job - Applied AI Engineer Join the Engineering Team, where you'll help build...  ...and PII exposure before an auditor does. Execution & Experimentation: Take a defined problem and run with it. Contribute to our quarterly... 
    Full time
    Manual labor
    Work at office
    Worldwide
    1 day per week

    Contactmonkey

    Toronto, ON
    16 days ago
  • usd20 per hour

     ...What if your knowledge French languagecould help improve the AI. WHAT YOU'LL DO Review, evaluate, and validate AI-generated...  ...skills PROJECT DETAILS Job Title: Generative AI Analyst - French ( Canada ) Location: Fully remote in Canada with... 
    Remote job
    Hourly pay
    Freelance
    Work at office

    Welocalize

    Toronto, ON
    more than 2 months ago
  • $78k - $90k per year

     ...Who We Are Konrad is an AI-driven digital consultancy and product-innovation firm providing AI, strategy, design, and technology services...  ...analysis capacity across client engagements. As a Product Analyst, you are an early-to-mid career professional with a strong foundation... 
    Full time
    Work from home
    Flexible hours

    Konrad Company

    Toronto, ON
    7 days ago
  • $73k - $82k per year

     ...and automation together in a single place, and we are expanding its AI capabilities faster than ever. If you want to work on a product...  ...organisations that want to plan smarter and move faster.  As a Business Analyst on the Professional Services team, you will work directly with... 
    Full time
    Temporary work
    Internship
    Work at office
    Remote work

    Prophix

    Toronto, ON
    14 days ago
  • $57.5k - $95k per year

     ...Join a growing Canadian P&C insurer where technology, enterprise analytics, and bold investments in AI are creating new possibilities for actuarial work.  As an Actuarial Analyst, you will help shape the next generation of actuarial models and predictive analytics solutions.... 
    Long term contract
    Full time

    Gore Mutual Insurance

    Toronto, ON
    17 days ago
  •  ...partnerships we’ll always find EMPATHY WHAT IS YOUR ROLE As a Credit Analyst, you will manage credit risk across the Invoice to Cash cycle,...  ..., and recommend improvements, including where automation or AI tools can take on routine reviews. Support internal and... 
    Full time

    Boldr

    Toronto, ON
    17 days ago
  •  ...recurring service into sustained customer momentum. As a Business Analyst, you’ll independently lead day-to-day delivery, keep priorities moving...  ...services investment. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications... 
    Full time

    Sitetracker

    Toronto, ON
    18 days ago
  • $38k - $40k per year

     ...integrated experiences that keep players in the game. The Service Desk Analyst will be responsible for providing technical assistance and support...  ...-breaking industry! Apply now! Rush Street Interactive uses AI-assisted tools at select stages of the hiring process to enhance... 
    Remote job
    Full time
    Internship
    Work at office

    Rush Street Interactive Inc.

    Toronto, ON
    2 days ago
  •  ...client is a leading Canadian financial institution seeking a senior AI Solution Architect to join its Solutions Architecture team. The...  ...designs through collaborative working sessions with business analysts, developers, and product owners. Select appropriate technology... 
    Long term contract
    Full time
    For contractors
    Internship
    Work at office
    Remote work

    Workana

    Toronto, ON
    19 days ago
  •  ...Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products...  ...We seek a highly organized, automation-minded Delivery Operations Analyst to connect GTM and Delivery Engineering teams under a unified... 
    Remote job
    Full time
    Internship
    Work at office
    Local area
    Home office

    Cohere

    Toronto, ON
    4 days ago
  • $150k - $160k per year

     ...Requisition Number: 105712   AI Engineer Location You will have the flexibility to work fully remotely. Insight at a Glance...  ...sur vous pour agir comme consultant(e) de livraison pratique et expérimenté(e), spécialisé(e) dans la création d’applications d’IA et d’IA agentique... 
    Full time
    Local area
    Remote work

    Insight

    Toronto, ON
    a month ago
  •  ...live test in days, call finished tests on time, ship winners the week they win, and flag a conversion drop the same day. Work Smart – AI and automation first. Use Claude to turn Clarity recordings, reviews and surveys into test ideas and draft test briefs; automate... 
    Full time
    Remote work
    Weekend work

    KittySpout

    Toronto, ON
    13 days ago
  • $70k - $85k per year

     ...About Alloy River Alloy River builds agentic applied AI for finance and accounting. Accounting today is fragmented, manual, and reactive. We believe it should be intelligent, structured, and operationally decisive. Our mission is to transform finance from a slow, labor-intensive... 
    Full time
    Work at office
    Flexible hours

    Alloy River

    Toronto, ON
    25 days ago
  • $80k - $100k per year

     ...Description Cybersecurity Analyst Who we are: Creyos (formerly Cambridge Brain Sciences) is a leading growth-stage B2B SaaS HealthTech...  ...an annual salary of $80,000 - $100,000 CAD. Creyos uses an AI-powered tool as part of an automated process to support our hiring... 
    Full time
    Internship
    Work at office

    Creyos

    Toronto, ON
    25 days ago
  • $80k - $95k per year

     ...Job Title: Analyst, Business Intelligence Department: Sales Operations & Analytics Master Department:...  ...actionable analytics. The Business Intelligence Analyst leverages AI-powered tools such as ChatGPT, Claude, Copilot, and other emerging... 
    Full time
    Internship
    Work at office

    Jeeter

    Toronto, ON
    15 days ago
  • $95k - $105k per year

     ...ll join us. About the role: We are looking for a Senior QA Analyst to join our testing team! You’ll get to work on an amazing team,...  ...technologies to ensure quality. With an eye and interest in integrating AI, you’ll help us improve and scale our sales financing platform!... 
    Full time
    Internship
    Work at office
    Flexible hours
    Shift work

    Financeit

    Toronto, ON
    19 days ago
  •  ...of a growing and dynamic commercial team, the Commercial Mortgage Analyst is responsible for underwriting annual reviews for CMHC-insured commercial...  ...and beyond. As part of our recruitment process, EQ uses AI to help screen, assess, and/or select applicants for this position... 
    Hourly pay
    Permanent employment
    Full time
    Internship
    Work at office

    Eq Bank

    Toronto, ON
    3 days ago
  • $85k - $120k per year

     ...Canada’s top-performing asset managers? We are looking for a Data Analyst for an existing vacancy in our Investment Data Architecture (...  ...****@*****.*** if you require accommodation. AI may be used to support certain stages of our screening & recruitment... 
    Full time
    Internship
    Work at office
    Remote work
    Flexible hours

    Connor, Clark

    Toronto, ON
    3 days ago
  •  ...opportunity.  We can’t wait to get to know you!  The Work The Analyst, Credit Risk Management is responsible for executing independent...  ...reporting related to lending portfolio risk, including leveraging AI-enabled analytics and automation tools such as Microsoft Copilot... 
    Hourly pay
    Permanent employment
    Full time
    Internship
    Work at office
    Shift work

    Eq Bank

    Toronto, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Experimentation Analyst - AI Trainer. Be the first to apply!