Domain Contributor - Evaluation Specialist
micro1
pay
Required Skills
Domain depth
Source verification
Reasoning clarity
Evaluation expertise
About micro1
micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.
Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.
Role Title: Domain Contributor - Evaluation Specialist
Role Type: Contractor (~15 hrs/week)
Location: Remote
micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
Scope of Work
Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
Apply detailed task guidelines and evaluation rubrics consistently to each submission.
Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
Preferred Qualifications
Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
Advanced research skills with a track record of verifying complex claims against authoritative sources.
Exceptional written and verbal communication skills to articulate findings and feedback.
Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
Background in adversarial or “stomp the model” task design is advantageous.
Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.
Continue
or
Continue with Google
Continue with LinkedIn
Have any questions? See FAQs
Refer and Earn
$100
- ...are hiring a senior finance domain expert to work directly with... ...are looking for a practising specialist rather than a generalist.... ...challenging finance tasks and evaluation sets, and help build finance-... ...progression to a senior individual-contributor or leadership level — for...SuggestedFull timeContract workPart timeFreelanceLive InManual laborRelocationRelocation package
$50 - $100 per hour
...models and agents. We provide frontier evaluations and reinforcement learning environments... ...Our AI recruiting agent sources and vets domain experts for our data platform that enables... ...Role Title: Software Engineer (GitHub Contributor) Role Type: Contractor Location: Anywhere...SuggestedLong term contractFor contractorsInternshipRemote work- ...Aptura Aptura is an applied AI and data company working with frontier labs to train AI systems on real professional work. We do this by building high-quality evaluation and training environments that teach AI agents to produce work that can be used in daily workflows....SuggestedContract workFor contractorsImmediate startRemote work
- ...AI labs and enterprises to improve frontier AI models through high-quality data, expert human feedback, and rigorous evaluation frameworks. Our contributors work on cutting-edge projects spanning coding, reasoning, agentic workflows, software engineering, and multimodal AI...SuggestedContract workPart timeFor contractorsFreelanceRemote workWorldwide
$100 - $150 per hour
...data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering... ...into high-quality training data, evaluations, and feedback loops that improve how AI systems...SuggestedPart timeFor contractorsImmediate startRemote workFlexible hours- ..., and able to work independently and meet deadlines in a remote setting. Preferred Qualifications Project maintainer or core-contributor experience. Experience with large or distributed code bases. Code-review experience. Rights, Confidentiality and Data Handling...Hourly payLong term contractContract workFor contractorsRemote work
- ...looking for Subject Matter Experts from private equity, as sector specialists or generalists, who build LBOs, returns analyses and portfolio... ...on real professional work. We do this by building high-quality evaluation and training environments that teach AI agents to produce work...Contract workFor contractorsImmediate startRemote work
$40 - $100 per hour
...Professional — Voice and Video Contributor based in Canada. Put your... ...expertise to work helping train and evaluate the next generation of... ...reasoning, relevant examples, and domain knowledge. - Engage... ...that support AI training and evaluation. - Use only fictional or appropriately...Hourly payFull timeContract workRemote work$40 per hour
...Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview...Part timeRemote workFlexible hours- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Contract work
- ...with 5+ years in claims and insurance, regulatory-risk quant, trade compliance, logistics, production planning or marketing analytics. A domain degree or certification; you have automated part of your own job (SQL, Python or advanced Excel). Hardware & Robotics: mechanical,...Part timeRemote work
- ...hiring a senior insurance and actuarial domain expert to work directly with a leading AI... ...improving. We are looking for a practicing specialist rather than a generalist. This is a... ...: Design challenging insurance tasks and evaluation sets, and help build domain-specific skills...Full timeContract workPart timeFreelanceLive InManual laborRelocationRelocation package
$25 - $35 per hour
...session, you fill out a structured form documenting your strategies, mistakes, and key turning points. This data is used to train and evaluate game-playing AI agents. Strong spatial reasoning and the ability to articulate your decision-making process are the core skills...Contract work10 hours per week$20 - $25 per hour
...advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that... ...of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice...Hourly payPart timeFixed term contract- ...models by annotating and labeling data specific to mechanical engineering. Review and validate AI-generated content for accuracy and domain relevance. Provide expert insights to enhance AI model performance in the mechanical engineering field. Collaborate with cross-...Contract workFlexible hours
- ...Evaluate AI-generated nutrition content for scientific accuracy and relevance. About Turing: Based in San Francisco, California,... ...assignment/freelancer (no medical/paid leave) Duration: 8 weeks Evaluation Process: ~ Shortlisting based on qualifications and one...For contractorsFreelanceRemote workFlexible hours
- ...enhancing their models by offering high-quality proprietary data. This data can be used as a basis for fine-tuning models or as an evaluation set to benchmark the performance. In an SFT data generation workflow, you might have to put together a prompt that contains code...Contract workPart timeFor contractorsFreelanceRemote work
- ...to translate complex scientific concepts into precise, self-contained questions. Experience evaluating AI-generated scientific responses or working with AI/ML evaluation datasets. Peer-reviewed publications or graduate-level teaching and mentoring experience....Contract workPart timeFor contractorsFreelanceRemote workFlexible hours
- ...training frontier models and evaluating AI agents. Experts contribute... ...subject matter knowledge across domains such as finance, healthcare,... ...high-quality training data, evaluations, and feedback loops that... ...AI. Role Title: Paid Photo Contributor Opportunity (Siblings) Location...Part timeRemote work
- ...looking for an Investment Banking AI Research Contributor based in Canada. As an Investment... ...leverage your financial expertise to help evaluate and improve the capabilities of advanced... ...assignments and developing precise evaluation criteria, you will help establish reliable...Full timeImmediate startRemote workFlexible hours
- ...Evaluate and improve AI responses using your domain expertise. About Turing: Based in San Francisco, California, Turing is the world’s leading research... ...highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language...
- ...Key Responsibilities Review and evaluate posts on various social media platforms. Identify and analyze the quality of information shared. Provide constructive feedback to enhance content credibility. Key Requirements: Must be located in Myanmar Native/Bilingual...Contract workFor contractorsRemote work
- ...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is... ...We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language... ...Generative AI, prompt engineering, or AI evaluation. Published research, industry recognition...Contract workPart timeFor contractors
- ...Evaluate and improve AI models using sports knowledge and data analysis. About Turing:... ...We are seeking a highly qualified Sports Domain Expert to evaluate and improve Large Language... ...Generative AI, prompt engineering, or AI evaluation. Published research, industry...Contract workPart timeFor contractors
- ...your native language. Check language and audio requirements. Domain: Data Collection · Type: Data Collection · Pay: $75 · Location:... ...Canada Data Collection Bilingual Code-Switching Conversation Contributor Available in . Apply now on OneForma. One-off paid session per recorded...Part timeRemote work
- ...to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities in coding, reasoning, tool use, and multimodality. In coding...Contract workPart timeFreelanceRemote workFlexible hours
- ...and review the speech data frontier AI labs train and evaluate on. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and... ...hiring process works Apply at /apply/bilingual-audio-contributor-indian-english. About five minutes. Resume plus a few...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- About the Role Aptura is looking for Subject Matter Experts from investment banking or M&A advisory who build merger models, pro formas and valuation work in Excel. You have used AI tools on your own work and been frustrated by the mistakes they make. You will turn that ...Contract workFor contractorsImmediate startRemote work
- Pay: $60 one-time Commitment: Hourly, ~40 h/week Field: Life, Physical, and Social Science What this is We're building a de-identified, real-world health dataset from Apple Health exports. Each contribution joins your on-device HealthKit data (activity, heart...Hourly payContract work
- ...We have a new quick-turnaround audio project and are looking for authentic Punjabi-accented English speakers to join as voice contributors. You will record yourself reading a short script by following a simple step-by-step guide — the work takes approximately 15 minutes or...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Domain Contributor - Evaluation Specialist. Be the first to apply!
