Senior Software Engineer - Python / TypeScript | AI Evaluation

We are looking for experienced Senior Software Engineers to support a technical AI evaluation project involving data pipelines, evaluation workflows, and preference-data quality.

What You'll Do

• Design, refine, and maintain evaluation rubrics and criteria for preference data
• Review and label data with a strong focus on quality and consistency
• Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation
• Analyze findings and communicate clear technical recommendations
• Collaborate with researchers and engineers to turn qualitative judgments into scalable processes

Required Skills

• 5+ years of professional software engineering experience
• Strong proficiency in Python , particularly building and maintaining pipelines or infrastructure
• OR strong experience with TypeScript, Golang, or JavaScript
• Experience navigating or contributing to large codebases is a plus
• Hands-on experience with preference data collection and/or rubric creation
• Strong debugging, analytical, and problem-solving skills
• Excellent written and verbal communication
• Ability to evaluate technical quality and clearly explain why an implementation or output is effective