Senior Software Engineer - AI Code Ranking

About The Role

What if your deep software engineering expertise could directly shape how the next generation of AI writes code? We're looking for senior-level developers in the Toronto area to evaluate, compare, and rank AI-generated code — helping AI systems learn what separates good code from great code.

You'll review pairs of code solutions, assess them on correctness, efficiency, readability, and best practices, and provide the preference rankings that teach AI models to produce better software. Your engineering judgment becomes the training signal that makes AI smarter.

This is a fully remote, flexible contract role designed for experienced software engineers who want meaningful, intellectually engaging work on their own schedule.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Compare pairs of AI-generated code solutions and rank them based on quality, correctness, and engineering best practices
• Evaluate code for functional accuracy — verifying that solutions produce correct outputs across standard and edge cases
• Assess code quality factors including readability, efficiency, maintainability, and adherence to idiomatic patterns
• Identify bugs, logic errors, security issues, and performance bottlenecks in AI-generated code
• Write clear, structured justifications explaining your ranking decisions
• Work across multiple programming languages and problem domains — from algorithms and data structures to systems design and API integrations
• Complete task-based assignments independently on your own schedule

Who You Are

• Senior-level software engineer with 5+ years of professional development experience
• Proficient in at least two of the following: Python, JavaScript/TypeScript, Java, C++, Go, or Rust
• Strong understanding of algorithms, data structures, and computational complexity
• Experienced in code review — you can quickly spot issues and articulate what makes one solution better than another
• Deep knowledge of software engineering best practices: clean code, design patterns, testing, and performance optimization
• Clear written communicator who can explain technical reasoning concisely
• Self-motivated and consistent when working independently without supervision

Nice to Have

• Experience with machine learning, AI/ML pipelines, or training data curation
• Background in competitive programming, technical interviewing, or algorithmic problem-solving
• Familiarity with RLHF (Reinforcement Learning from Human Feedback) or preference-based AI training
• Experience across both backend and frontend development
• Contributions to open-source projects or technical mentoring experience
• Knowledge of security best practices and common vulnerability patterns

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Your engineering expertise directly shapes how AI understands and generates code at scale
• Intellectually stimulating work that keeps your skills sharp across languages and domains
• Potential for ongoing work and contract extension as new projects launch