Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Database Systems Evaluation Expert

Temporary

Mercor

Pay: $2,200/task
Commitment: Task based
Field: Software Engineering

Applications close Tuesday, October 13, 2026 at 12:00 p.m. Pacific. We are selecting the first three applicants who qualify for the initial pilot.

About the work

Build real-world tasks that test how well AI agents handle database engineering. Depending on your specialty, your task may cover database-engine implementation, production diagnosis, or application migration.

Each task should include a clear problem statement, a reproducible repository or environment, a working reference solution, tests, and grading criteria that distinguish a robust engineering solution from one that only appears correct.

What you'll do

  • Design one challenging, self-contained database engineering task.
  • Build checks for correctness, failure handling, concurrency, retries, and regressions where relevant.
  • Evaluate performance measures such as latency, throughput, and memory use.
  • Write clear grading criteria for engineering judgment.
  • Work with technical reviewers to refine and validate the task.

Who we're looking for

  • At least five years of hands-on database-engine internals experience, or a database-systems PhD.
  • Deep experience with storage engines, query execution, optimization, transactions, replication, or related low-latency systems.
  • Strong implementation skills and clear explanations of correctness and performance tradeoffs.

DBA, SQL analytics, ETL, or application-only database experience does not qualify on its own. You do not need to specialize in every task area.

Application process

Complete a self-paced technical assessment with written responses and a coding exercise. You control when to advance between sections. (~35 min)

Use a laptop or desktop with a camera, microphone, and entire-screen sharing. Have your own editor and terminal ready, along with Python 3.8+ and a compiler for C, C++, Rust, Go, or Java. The assessment includes a starter kit and public tests. Complete the assessment independently, without outside AI assistance.

Please apply as soon as possible. We will select the first three qualifying applicants. If the pilot fills, completed assessments may be considered for future work if the project expands.

Paid task after selection

Selected experts will complete one task, with approximately 25 hours of work, followed by technical review and feedback.

Task deadline: Friday, October 30, 2026.

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Database Systems Evaluation Expert in Remote vacancy
  •  ...TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students, graduates...  ...Responsible AI behaviour Domain-Specific AI Evaluation Healthcare & Medicine Law Finance,... 
    Suggested
    Part time

    TELUS International

    Remote
    13 days ago
  •  ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes... 
    Suggested
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Rise Data Labs

    Remote
    12 days ago
  •  ...use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work...  ...quality. Develop clear evaluation rubrics and scoring criteria, identifying...  ...training will be provided to selected experts. Who You Are We're looking... 
    Suggested
    Contract work

    Rise Data Labs

    Remote
    12 days ago
  •  ...applications and next steps. Our partner is looking for a Database & Geographic Information System (GIS) Geologist, Special Projects based in Canada. This...  ..., secure, well-documented, and ready for technical evaluations and resource development. You will also contribute to due... 
    Database
    Full time
    Remote work

    Jobgether

    Remote
    7 days ago
  • $100 - $120 per hour

     ...week Field: Other Engineering Mercor is seeking experienced Systems & Integration Engineers to support an advanced engineering and...  ...real physical products and hardware systems. Review and evaluate system requirements, interfaces, integration plans, verification... 
    Suggested
    Part time
    Remote work
    Flexible hours

    Mercor

    Remote
    19 days ago
  • $50 - $150 per hour

     ...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract...  ...industry) Prior experience with data annotation or AI model evaluation Experience reviewing or publishing research papers... 
    Contract work
    Temporary work
    Internship
    Remote work
    Flexible hours

    Braintrust

    Remote
    12 days ago
  •  ...models. # Overview We are hiring a senior finance domain expert to work directly with a leading AI lab's research and program management...  ...and domain depth: Design challenging finance tasks and evaluation sets, and help build finance-specific skills and tools together... 
    Full time
    Contract work
    Part time
    Freelance
    Live In
    Manual labor
    Relocation
    Relocation package

    Mercor

    Remote
    12 days ago
  •  ...seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated...  ...is a short-term, fully remote evaluation task designed for mental health...  ...the evaluation of advanced AI systems. Contribute to research... 
    Temporary work
    Part time
    Remote work

    Mercor

    Remote
    12 days ago
  •  ...Create and evaluate board game tasks to enhance AI reasoning skills...  ...and deployment of powerful AI systems. Turing helps leading AI labs...  ...high-quality human feedback, evaluation, and training data. Role...  ...seeking Board Game Reasoning Experts to help train and evaluate... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    12 days ago
  •  ...new countries. Thanks to the work of our experts and their professional approach to business...  ...plans, we are currently hiring Oracle Database Administrator to strengthen our team and...  ...You understand production environments, system stability and operational responsibility.... 
    Database
    Permanent employment
    Full time
    Local area

    InfoConsulting Group

    Remote
    2 days ago
  • $100k - $135k per year

     ...every worklist, search, and assignment is a database that has to respond quickly and correctly....  ...type-safe, well-tested patterns while the system stays live for clinicians. This is a hands...  ...systems was a core part of the role. ~ Expert-level T-SQL on Microsoft SQL Server,... 
    Database
    Temporary work
    Local area
    Remote work

    Intelerad

    Remote
    1 day ago
  • $164.49k - $197.39k per year

     ...excellence, and evolving Tempo from a SaaS database into a platform that powers Grafana’s...  ...the teammates around you grow. Solid systems experience. Significant hands-on experience...  ...discovery endpoints, deterministic outputs, evaluation harnesses. Open-source contribution or... 
    Database
    Local area
    Remote work
    Shift work

    Grafana Labs

    Remote
    4 hours ago
  •  ...About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking,... 
    Full time
    Part time
    Remote work

    Turing

    Remote
    12 days ago
  •  ...AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge...  ...expertise into high-quality training data, evaluations, and feedback loops that improve how AI systems learn, reason, and perform. Our platform identifies... 
    Part time
    For contractors
    Remote work

    micro1

    Remote
    12 days ago
  •  ...Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role As Director of Engineering, Database Excellence, you will lead the Database Excellence stage and report to the Vice President of Data Engineering. You will set the... 
    Database
    Full time
    Internship

    Gitlab

    Remote
    15 days ago
  • $55 - $100 per hour

     ...level of a first-year PhD course. You'll be compensated at the Expert tier and are expected to maintain accuracy above the project's threshold...  ...electromagnetism Technical written communication Critical evaluation of mathematical derivations Meta-level scientific reasoning... 
    Contract work

    Claru

    Remote
    8 days ago
  •  ...Key Responsibilities Review and evaluate posts on various social media platforms. Identify and analyze the quality of information shared. Provide constructive feedback to enhance content credibility. Key Requirements: Must be located in Myanmar Native/Bilingual... 
    Contract work
    For contractors
    Remote work

    Appen

    Remote
    13 days ago
  •  ...Evaluate AI-generated nutrition content for scientific accuracy and...  ...enterprises deploying advanced AI systems. Turing supports customers in...  ...(e.g., food composition databases). Identify and flag mislabeled...  ...) Duration: 8 weeks Evaluation Process: ~ Shortlisting... 
    Database
    For contractors
    Freelance
    Remote work
    Flexible hours

    Turing

    Remote
    3 days ago
  • $85 per hour

     ...images presented on our digital platform. Evaluate each image against a specific set of...  ...exercise ($85) and onboarding; approved experts continue on ongoing work at $85/hour....  ...guidelines Ability to make clear, decisive evaluations between similar visual assets Access to a... 
    Ongoing contract
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    12 days ago
  •  ...About the Role We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian. What... 
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Rise Data Labs

    Remote
    12 days ago
  •  ...Literacy Tax Filing Data Review Rubric Evaluation Google Workspace About micro1...  ...models and evaluating AI agents. Experts contribute their diverse subject matter knowledge...  ..., and feedback loops that improve how AI systems learn, reason, and perform. Our... 
    Temporary work
    Part time
    For contractors
    Immediate start
    Remote work

    micro1

    Remote
    13 days ago
  •  ...Lead teams to create and evaluate realistic LLM conversational data. About Turing Turing...  ...and deployment of frontier AI systems. We work with the world’s top AI labs and...  ...review teams to deliver reliable training and evaluation datasets. What You’ll Do ~Lead and manage... 
    Contract work
    Part time
    Freelance
    Remote work

    Turing

    Remote
    12 days ago
  • usd16 per hour

     ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs...  ..., and help improve next-generation AI systems. Ideal for professionals with experience...  ...appropriateness. - Providing structured evaluations and feedback following the project... 
    Hourly pay
    Daily paid
    Full time
    Freelance
    Immediate start
    Remote work
    Flexible hours

    Rws

    Remote
    9 days ago
  •  ...’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance...  ...: This is a short-term engagement that starts ASAP Rôle : Évaluateur(trice) de langue française À propos du poste Nous... 
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Rise Data Labs

    Remote
    12 days ago
  •  ...We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains. You'll create complex research tasks that challenge AI capabilities in sports analytics, financial analysis, patent research, academic planning,... 
    Contract work
    For contractors
    10 hours per week
    Flexible hours

    AfterQuery

    Remote
    12 days ago
  •  ...About the Role We’re looking for contract, remote Japanese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs are natural, consistent, and aligned with real-world expectations in Japanese.... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    Rise Data Labs

    Remote
    12 days ago
  •  ...Design tests to evaluate AI safety and identify model failures. About Turing: Based...  ...global enterprises deploying advanced AI systems. Turing supports customers in two ways: first...  ...: This project supports the evaluation and improvement of safety behavior in large... 
    Ongoing contract
    Part time
    For contractors

    Turing

    Remote
    12 days ago
  •  ...About the Role We’re looking for contract, remote Swedish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs are coherent, consistent, and aligned with real-world expectations in Swedish.... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    Rise Data Labs

    Remote
    12 days ago
  •  ...About the Role We’re looking for contract, remote German-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are accurate, consistent, and aligned with real-world expectations in German.... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    Rise Data Labs

    Remote
    12 days ago
  •  ...About the Role We’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are coherent, consistent, and aligned with real-world expectations in Turkish.... 
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Rise Data Labs

    Remote
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Database Systems Evaluation Expert. Be the first to apply!