Ai evaluator jobs in Remote

 ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Malayalam for a short collaboration. Job Type...  ..., and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality... 

 ...on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Data Scientist AI Evaluation based in Canada. We are seeking a senior-level data scientist to establish and advance the evaluation practices that measure the quality... 

 ...steps. Our partner is looking for a Senior Software Engineer – LLM Evaluation based in Canada. This part-time consulting opportunity is...  ...curate high-quality code, develop software solutions, and assess AI-generated implementations against professional engineering standards... 

 ...Requisition Number: 106471   AI Engineer Location You will have the flexibility to work fully remotely. Insight at a Glance...  ...data sources. Implement prompt strategies, guardrails, and evaluation loops to improve reliability, safety, and quality. Be AmbITious... 

 ...Us We’re a fast-growing product company integrating cutting-edge AI capabilities into our core offering to stay competitive and...  ...heavy AI models ~ Applied machine learning experience — training, evaluating, and maintaining small task-specific models. ~ Familiarity with... 

 ...applications and next steps. Our partner is looking for a Director AI - AdFarm based in Canada. As Director of AI & Innovation, you...  ...that support innovation and measurable client outcomes. - Technical Evaluation and Governance: Assess potential solutions for reliability,... 

 ...steps. Our partner is looking for a Staff AI Developer based in Canada. Overview Join an...  ...and optimize LLM-powered applications, evaluate emerging orchestration frameworks, explore...  ...tuning approaches, and implement appropriate evaluation methods and safeguards. - Machine Learning... 

 ...memory or session management. Create production system prompts, evaluation datasets, LLM-as-judge workflows, RAGAS-style metrics, and...  ...powered systems in production. ~ Hands-on expertise with agentic AI, reasoning loops, tool or function calling, and single- and multi... 

 ...applications and next steps. Our partner is looking for a Staff Engineer / AI Builder based in Canada. This is a senior technical leadership...  ...scale. You’ll architect agentic workflows, RAG pipelines, evaluation frameworks, and cloud-native services that solve real business problems... 

 ...flexible and built for scale. With Grafana Cloud's actually useful AI, organizations can see, understand, and act on all their...  ...including logging, performance metrics, prompt iteration, model evaluation, and cost management Establish governance and compliance standards... 

 ...ABOUT US Circle is building the world’s leading AI-powered, all-in-one platform for digital businesses. We make it possible for creators...  .... We’re looking for a Lead Engineer to help us build out the evaluation frameworks, observability tooling, and diagnostic infrastructure... 

 ...Responsibilities Build and operate AI agents, integrations, and workflows for the GTM...  ...conversion, and pipeline contribution. Evaluate AI outputs, manage integration failures,...  ...context design, retrieval, tool use, and output evaluation. Experience with workflow platforms... 

 ...About ElevenLabs ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January...  ..., building the solution, and measuring the impact Developing evaluation and monitoring frameworks so our AI-native workflows are reliable... 

 ...next steps. Our partner is looking for an Artificial Intelligence (AI) Technician based in Canada. This is a remote opportunity for a...  ...bank transaction imports and accounting processes. - Implement and evaluate reconciliation and intelligent bookkeeping solutions to improve... 

 ...manages all applications and next steps. Our partner is looking for a AI Trainers Network - English based in Canada. As part of a global...  ...on flexible, remote projects involving AI training, annotation, evaluation, and prompt creation. Projects can range from short assignments... 

 ...applications and next steps. Our partner is looking for a Product Engineer (AI-Native) based in Canada. Own product features end-to-end, from...  ...their output within a large and complex production codebase. - Evaluate AI-generated implementations carefully, identify errors or... 

 ...AI Security Researcher / Research Engineer Remote or hybrid - London preferred but North America, EU, UK accepted About Brave:...  ...products. Responsibilities   Design and execute adversarial evaluations to uncover failure modes in LLM-powered web agents and chatbots (... 

 ...Teams move faster, stay on brand, and get AI marketing that actually works. Founded...  ...Our interview process focuses on evaluating fit for the most important dimensions of...  ...are low signal to noise and aren’t a good evaluation mechanism. Recruiter Screen [30m]: Introductory... 

 ...AI Systems Researcher / Research Engineer London (Preferred) - Hybrid, or Remote in North America, EU, UK About Brave Brave is...  ...Performance Researcher/Engineer to shape and improve our performance evaluations and optimizations across desktop and mobile. If you’re passionate... 

 ...difference—while still maintaining a healthy work-life balance. Who are we? Forward-thinking technology people with a heart. Join us. AI Sales Specialist Remote - CA Job category: Sales Job ID: 126629-en_US About NetApp We're forward-thinking technology... 

 ...Job Responsibility: Leonardo.Ai is seeking a Senior AI Researcher to join our expanding, global AI team. This is an exciting opportunity for AI or Machine Learning professionals and academics to join the brightest minds, helping Australia's most potent AI-powered platform... 

 ...Our work focuses on diverse areas including AI, social media, security and more. And we’...  ...the patterns for how we build, evaluate, and scale autonomous capabilities. This...  ...assisted engineering across the team. Drive Evaluation and Performance: Implement rigorous frameworks... 

 ...best financial applications, not for an exclusive few. If you’re this person, we’d love to talk to you. THE ROLE Secure BJAK’s AI-enabled products and agent workflows using third-party models. Focus on customer data shared with model providers, agent permissions, user... 

 ...next steps. Our partner is looking for a Senior Software Engineer | AI SaaS Software based in Canada. Join an innovative, remote-first...  ..., Codex, and Cursor to accelerate development while critically evaluating generated code and ensuring maintainability, reliability, and quality... 

 ...for agentic orchestration, enabling organizations to coordinate AI agents, people, and systems across complex, end-to-end business processes...  ..., RAG, function calling, structured outputs, automated evaluations – with the guardrails to match: validation, fallback logic, confidence... 

 ...That operating model is changing. Telnyx is increasingly building AI agents and automation that interact directly with the GTM stack....  ...experiments (A/B tests, prompt variations, model comparisons) with proper evaluation infrastructure to measure what's actually working Requirements... 

Über unsere Plattform Huacaya: Huacaya ist unsere On-Premise-Plattform für KI-Entwicklung und -Deployment. Sie ermöglicht es, KI-Modelle sicher und effizient zu hosten, zu trainieren und in Anwendungen wie Chats oder Prozessautomatisierungen zu integrieren. Die Plattform deckt...

 ...distinctive pillar of the Instacart Platform — an emerging portfolio of AI-driven retailer solutions — and the go-to-market infrastructure...  ..., including experience with modeling, forecasting, and evaluating solution performance. - Exceptional cross-functional leadership skills... 

 ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Video Editor based in Canada. This is a performance-driven creative role focused on producing high-volume, conversion-oriented video content... 

 ...and next steps. Our partner is looking for a Senior Automation & AI Implementation Specialist based in Canada. The Senior Automation...  ...fixes. - Ability to independently identify inefficient processes, evaluate available technologies, and select appropriate technical solutions...