Competitive Data Scientist Evaluator

Apply data science and Python expertise to evaluate coding agents through reproducible environments, testing, and rigorous solution verification.This Competitive Data Scientist role focuses on building reliable tasks and reference solutions for evaluating coding agents. You will prepare relevant data and dependencies, investigate failures, and refine tasks from observed behavior. The work suits candidates with data science, machine learning, quantitative modeling, or research competition experience.Key Responsibilities:
Build reproducible environments, data, dependencies, and reference solutionsDevelop tests distinguishing correct and flawed approachesRun coding agents against tasks and investigate failuresIdentify implementation errors, assumptions, and data leakageDocument requirements, reasoning, and verification stepsRequirements:
Experience in data science, machine learning, or quantitative modelingRelevant research competition experience, including Kaggle or DrivenDataStrong problem-solving ability and methodological understandingProgramming ability to implement and verify solutionsPython testing, debugging, and unfamiliar-code experience preferredBring analytical judgment, practical programming, and evaluation expertise to strengthen coding-agent task quality and correctness.
#J-18808-Ljbffr