Senior Ai Coding Agent Evaluator

Evaluate AI-generated code remotely from Canada using software expertise, detailed rubrics, and strong written communication skills. Flexible contract work offers 20+ hours weekly.As a Senior Software Engineer AI Data contributor, you will assess coding agents through codebases, tickets, source materials, and generated outputs. Your evidence-based reviews help improve AI system behavior. Prior AI training experience is not required.Key Responsibilities:
Evaluate model outputs against project guidelines and rubricsReview codebases, tickets, source materials, and generated codeDocument evidence-based judgments clearly in writingExplain decisions to improve model behaviorMaintain consistent quality across repeated review tasksRequirements:
Relevant professional, academic, or language expertiseStrong software and written communication skillsCareful attention to detail during reviewsAbility to apply detailed instructions and rubrics consistentlyComfort working independently on remote contractor tasksApply software judgment, careful review, and clear writing to evaluate AI coding agents for ongoing remote contract work.
#J-18808-Ljbffr