Senior QA Automation Engineer (Toronto)

About the Role

Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week.

What You’ll Do

• Design and lead test strategies for streaming workflows, playback systems, and AI-powered features.
• Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability.
• Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions.
• Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy.
• Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection.
• Contribute to automation and CI/CD frameworks, driving faster, more reliable releases.
• Help drive a shift-left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases.
• Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches.
• Monitor live environments for playback or recommendation anomalies post-release and escalates issues promptly.
• Continuously improve QA processes, metrics, and reporting for streaming and AI validation.

Your Background

• Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent hands‑on experience.
• 4+ years of QA Automation experience, preferably in streaming media or VOD/OTT platforms.
• Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG‑TS), DRM systems, and CDN architectures.
• Experience validating AI/ML systems in production — e.g., testing model output accuracy, user personalization logic, and algorithm stability.
• Hands‑on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI‑based visual testing.
• Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome DevTools).
• Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms.
• Familiarity with Python, TypeScript, or JavaScript for scripting and test automation.
• Understanding of data validation, logging pipelines, and A/B testing frameworks.
• Strong analytical and documentation skills, with a proactive approach to cross‑team collaboration.

Nice to Have

• Experience testing machine learning‑driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging.
• Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis).
• Familiarity with continuous testing and CI/CD environments (Jenkins, GitHub Actions, CircleCI).
• Understanding of observability tools (Grafana, Kibana, Datadog) for post‑deployment validation.
• Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes.

Benefits

• For all salaried employees, in lieu of the FOX Vacation policy, Tubi offers a Flexible Time Off Policy to manage all personal matters.
• For all full‑time, regular employees, in lieu of FOX Paid Parental Leave, Tubi offers a generous Parental Leave Program, which allows parents twelve (12) weeks of paid bonding leave (top up in Canada) within the first year of birth, adoption, surrogacy, or foster placement of a child in addition to applicable government leave program(s) and FOX's short‑term disability policy (if applicable). This time is 100% paid through a combination of any applicable government leaves and wage‑replacement programs in addition to contributions made by Tubi.
• For all full‑time, regular employees, Tubi offers a monthly wellness reimbursement.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.