Test evaluator jobs in Remote

 ...candidate is comfortable architecting and working across multi-file codebases, structuring realistic development environments, and building reproducible setups supported by clear documentation and testing. Experience with Docker and containerized workflows is essential.... 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...

 ...solutions to some of the toughest challenges facing our world. Find out how far your passion can take you. What will you do? As a Test Automation Developer , you will drive quality for a modern SaaS by collaborating with our Software Engineers. Responsibilities:... 

 ...Responsibilities Develop tests, supporting frameworks, and continuous delivery execution pipelines. Validate and test cloud-native architectures using Kubernetes and troubleshoot automated test pipeline failures. Collaborate with cross-functional engineering teams... 

 ...steps. Our partner is looking for a Satellite and Payload System Test Authority based in Canada. Take a leading role in validating advanced...  ...and ground-segment systems throughout the project lifecycle. - Evaluate system performance, diagnose technical issues, and troubleshoot... 

 ...our team working towards this goal, we would love to hear from you!  Role Overview We are looking for a Software Development Engineer in Test to help build and sustain high-quality software through strong test design, automation, and collaboration with engineering partners.... 

 ...methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively. We’re on the lookout for a Test Automation Engineer (Web) to join our team working on a social news aggregation platform. WHAT YOU WILL DO – Create and maintain... 

 ...Responsibilities Define test strategy and performance quality gates for the platform. Automate the software development lifecycle from testing through deployment and validation. Investigate deployment issues, identify root causes, and recommend solutions across environments... 

 ...What You'll Do Design and implement automated test systems, procedures, and test sequences for electrical and electronic hardware...  ...Electrical test automation, technical problem-solving, and expert evaluation We consider all qualified applicants without regard to... 

 ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...  ...Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects. Conduct... 

 ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Development Engineer in Test (Python) based in Canada. Join a collaborative Platform Engineering team focused on building and scaling reliable, high-performance... 

 ...Korea, India, Malaysia, Singapore, Canada, and the U.S. Want to know more details, please click on the website. Machine Learning Test Developer Location: Markham ON Key Responsibilities Test development for Computer Vision / Machine Learning (CVML) applications... 

 ...Project Overview We are looking for experienced and safety-focused Test Drivers to support a road data collection project focused on capturing information about road signs, traffic lights, and other road infrastructure. Drivers will operate a project vehicle along predefined... 

 ...ability to accurately interpret content and assess linguistic issues. Detail-oriented and comfortable with linguistic and stylistic evaluation tasks as well as the technical aspect of this evaluation (synchronicity mainly). Basic understanding of transcription formats and... 

 ...Wir rekrutieren einen Software Test Engineer (m/w/d) für ein neu formiertes Team rund um ein Dynamics 365 Projekt. Das Testing wird von Grund auf neu aufgebaut, du bist also massgeblich an der Definition des Vorgehens beteiligt. Du testest im Sprint mit und verantwortest gleichzeitig... 

 ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements... 

 ...based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is project-based....  ...(MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While... 

 ...We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains. You'll create complex research tasks that challenge AI capabilities in sports analytics, financial analysis, patent research, academic planning, and... 

 ...Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role As Staff Product Manager, Test & Code Coverage, you'll build product capabilities from initial discovery through launch and adoption. You'll help engineering teams understand... 

 ...Pay: $30 - $60/hour Required Skills Domain depth Source verification Reasoning clarity Evaluation expertise About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement... 

 ...About the Role We’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are coherent, consistent, and aligned with real-world expectations in Turkish.... 

 ...About the Role We’re looking for contract, remote Spanish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs actually make sense, stay consistent, and reflect real-world... 

 ...will be shared during onboarding. Skills & requirements Physics problem solving Graduate-level mechanics and electromagnetism Technical written communication Critical evaluation of mathematical derivations Meta-level scientific reasoning Category: RLHF... 

 ...About the Role We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian. What... 

 ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...  ...Researcher) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer'... 

 ...We are looking for an experienced Test Lead to drive the Quality and Validation strategy for a high-impact solution, in a highly regulated...  ..."correct" output, setting success thresholds, and establishing evaluation methods (including handling hallucinations and grounding rules).... 

 ...About the Role We’re looking for contract, remote Portuguese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs make sense and reflect real-world expectations in Portuguese... 

 ...Review technical slide decks from your specific domain Rank presentations based on clarity, structure, and technical communication Evaluate design reviews, roadmaps, and experiment readouts Provide clear feedback on what makes a specific presentation effective Who Should... 

 ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Telugu for a short collaboration. Job...  ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality... 

 ...About the Role We’re looking for contract, remote Japanese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs are natural, consistent, and aligned with real-world expectations in Japanese....