Senior Software Engineer

Responsibilities

• Lead the design and implementation of closed-loop multi-agent state machines, human-in-the-loop flows, and generative AI testing frameworks.
• Develop distributed agent execution environments that autonomously run and self-heal end-to-end tests.
• Build statistical validation, probabilistic rubric, and calibration frameworks for measuring feature quality, model drift, and non-deterministic agent behavior.
• Own technical designs, reusable components, CI/CD workflow improvements, and distributed execution services.
• Diagnose code, data, and infrastructure failures, resolve root causes, and mentor engineers through reviews and knowledge sharing.
• Act as product owner by defining requirements, scope, success criteria, delivery plans, estimates, risks, and dependencies with stakeholders.
• Evaluate new engineering approaches, including AI-assisted workflows, and measure reliability, feedback-speed, and adoption improvements.

Requirements

• 10+ years of professional software development experience.
• Bachelor’s or master’s degree in Computer Science, Software Engineering, or a related field with coursework or academic exposure to AI/ML concepts.
• Proficiency in C# or C++ and Python, with experience designing complex software systems, automated testing, and version control.
• Experience independently implementing complex software systems with interfaces, dependencies, and documented trade-offs.
• In-depth experience with LLMs, multi-agent orchestration, state machines, context and memory management, and human-in-the-loop workflows.
• Proficiency in statistical inference, hypothesis testing, variance reduction, and experimental design for probabilistic systems.
• Experience developing generative-system evaluation frameworks, including dataset curation, LLM-as-a-judge design, validation criteria, error analysis, and quantitative and qualitative metrics.
• Experience building test automation or developer tools, integrating them into CI/CD workflows, and debugging distributed systems using logs and telemetry.

Benefits

• British Columbia base salary range is CAD 141,400–204,400.
• Three weeks of vacation per year to start and 10 sick days per year.
• Paid top-up to EI/QPIP benefits up to 100% of base salary for qualifying maternity, parental, and adoption leave.
• Extended health, dental, and vision coverage; life and disability insurance; and a retirement plan for regular full-time employees.
• Some roles may be eligible for bonus and other incentive programs.
• The role is based in Vancouver or elsewhere in British Columbia depending on location.