Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Machine Learning Engineer, SecureAI

$192k - $264k per year

Okta

Secure Every Identity, from AI to Human

Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence.

This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.

About Okta Secures AI Team

 The Okta for AI Agents Team is building the future of digital identity management. The way companies are using agents and allowing them access is undergoing a fundamental shift, enabling teams to move fast while staying secure. 

Our North Star is clear: To get AI right, you have to get identity right. We are not just managing identities; we are building the industry's first Identity Security Fabric for the agentic era. As organizations rapidly deploy AI, these non-human entities are acting with access to critical tools, often bypassing traditional perimeters and creating a 'Shadow AI' crisis. Our mission is to move identity from a reactive gatekeeper to a unified control plane, transforming AI risk into business ROI.

We are tackling this by implementing a comprehensive four-pillar maturity model: Discover, Onboard, Protect, and Govern. We are driving innovation by defining the standards for Agentic Identity—including pioneer work with securing AI Agents and support for protocols like MCP. You will be helping us build the infrastructure that allows enterprises to scale AI safely, ensuring every access decision—whether made by a human or an automated agent—is authenticated, authorized, and audited at scale.

We are a diverse team of engineers, product managers, and designers who are bringing Okta’s expertise in identity to define the future of Agent Identity management, focusing on enablement while staying secure.

About the role

In this role, you will join the Agent Access Policies sub-team under Okta Secures AI as a Principal Machine Learning (ML) Engineer to advance Okta's authorization capabilities. By replacing static, rule-based systems with dynamic AI security mechanisms, you will deliver real-time threat inspection, agent intent evaluation, and behavioral analysis—ensuring autonomous AI agents operate safely within specified bounds.

Your core mission will be architecting and driving features for our unified control plane to establish the premier Identity Security Fabric for the agentic era. In doing so, you will help execute our guiding principle: "To get AI right, you have to get identity right."

What you’ll be doing 

  • Implement intent-based enforcement to verify agent runtime requests match their intended purpose, requiring key capabilities.
  • Apply LLM reasoning and prompt parsing to interpret prompts, tool payloads, and intent in real time.
  • Integrate low-latency inference or semantic evaluation engines directly into the API gateway request path.
  • Use embeddings, vector search, or zero-shot classification to score alignment between agent intent and executed actions.
  • Design confidence-scored decision engines that feed semantic verification results into policy frameworks (e.g., Cedar).
  • Establish evaluation benchmarks, prompt injection defenses, and guardrails to prevent bypasses or false positives.
  • Architect scalable ML and Generative AI systems integrating retrieval, inference, and evaluation pipelines.
  • Optimize prompting, context retrieval, and RAG workflows for accuracy, safety, and efficiency in Claude-based systems.
  • Build automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
  • Implement schema validation, structured output enforcement, and guardrails to ensure reliable, compliant AI outputs.
  • Mentor and coach engineers to support team and community growth.

What you’ll bring to the role

  • 10+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
  • Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
  • Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
  • Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
  • Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
  • Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
  • Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
  • Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
  • Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.                                                                                                            

Extra credit

  • Experience integrating AI-driven systems with identity, authentication, or security products.
  • Exposure to ethical AI, model risk, or compliance frameworks.
  • Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.

Education:Bachelor’s or Master's degree in Computer Science or related field

(P25822_3552624)

#LI-Hybird

#LI-BB1

Below is the annual base salary range for candidates located in San Francisco Bay Area. Your actual base salary will depend on factors such as your skills, qualifications, experience, and work location. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program please visit: .   

The annual base salary range for this position for candidates located in the San Francisco Bay area is between: $192,000—$264,000 CAD

The Okta Experience

We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please  use this Form to request an accommodation.

Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please  click here to view our full NYC AEDT Notice.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Principal Machine Learning Engineer, SecureAI in Toronto, ON vacancy
  • $184k - $253k per year

     .... We are a diverse team of engineers, product managers, and designers...  .... About the role As a Principal Software Engineer on the Agent...  ...applicable plans and policies. To learn more about our Total Rewards...  ...use artificial intelligence, machine learning, or other automated... 
    Principal
    Full time
    Local area
    Worldwide
    Shift work

    Okta

    Toronto, ON
    1 day ago
  • $400k per year

     ...Job Description: Position: Machine Learning Engineer Location: Remote / Hybrid Employment Type: Full-time Responsibilities Design, train...  ...in Python and ML frameworks (TensorFlow, PyTorch, Scikit-learn). Experience with cloud platforms (AWS, GCP, Azure) and containerization... 
    Suggested
    Full time
    Remote work
    Relocation

    MS Systems

    Toronto, ON
    2 days ago
  • $160k - $220k per year

     .... We are a diverse team of engineers, product managers, and designers...  ...request-time authorization engine at the Agent Gateway and at the...  ...applicable plans and policies. To learn more about our Total Rewards...  ...use artificial intelligence, machine learning, or other automated... 
    Suggested
    Full time
    Local area
    Worldwide
    Shift work

    Okta

    Toronto, ON
    11 days ago
  • $110k - $130k per year

     ...patient care! And you’re joining a thrice-certified Great Place to Work!  Your Role Clarius Mobile Health is seeking a Machine Learning Engineer to contribute to a special project focused on expanding access to ultrasound technology while advancing our next-generation... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Fixed term contract
    Work at office
    Remote work
    Worldwide

    Clarius Mobile Health

    Toronto, ON
    a month ago
  • $70 - $85 per hour

     ...transform business outcomes. Our engineers and designers harness cloud-...  ...~Grow Our People – Feedback, learning, leadership ~Do the Right Thing...  ...include building scalable machine learning models, designing feature...  ...learning frameworks (Scikit-learn, TensorFlow, PyTorch).... 
    Suggested
    Full time
    Contract work

    Architech Solutions

    Toronto, ON
    more than 2 months ago
  • $168k - $231k per year

     ...audited at scale. We are a diverse team of engineers, product managers, and designers who are...  ...our applicable plans and policies. To learn more about our Total Rewards program,...  ...Law 144, that use artificial intelligence, machine learning, or other automated processes to... 
    Long term contract
    Local area
    Worldwide
    Shift work

    Okta

    Toronto, ON
    7 days ago
  • $140k - $180k per year

     ...where AI isn’t a buzzword—it’s the engine of our success. We’re looking for...  ...a focus on architecting deep learning systems and sophisticated model pipelines...  ...along with experience with machine learning libraries and frameworks (e.g. scikit-learn, XGBoost,...) ~ Experience with... 

    Movable Ink

    Toronto, ON
    9 days ago
  • $118.8k - $148.5k per year

     ...work environment where all team members belong and have the opportunity to thrive. Machine Learning is at the heart of Lyft’s products and decision-making. Machine Learning Engineers at Lyft operate in dynamic environments, moving quickly to build the world’s best transportation... 
    Hourly pay
    Full time
    Work at office
    Flexible hours
    3 days per week

    Lyft

    Toronto, ON
    more than 2 months ago
  •  ...We are looking for a Machine Learning Engineer to join our Toronto team and help us take our products to the next level in terms of visual intelligence...  ...with frameworks such as PyTorch, TensorFlow and scikit-learn Practical knowledge of CNNs and modern computer vision architectures... 
    Full time
    Internship
    Manual labor
    Work at office
    3 days per week

    Invision AI

    Toronto, ON
    a month ago
  • $185k - $225k per year

     ...entire AI Products team. You will champion engineering excellence, mentor junior engineers,...  ...Data & Science division. As a Sr. Machine Learning Engineer, you'll partner closely with Applied...  ..., SQL, and distributed processing engines such as Spark or Dask to handle web-scale... 
    Permanent employment
    Work at office
    Remote work
    Flexible hours

    Xero

    Toronto, ON
    a month ago
  •  ...: Toronto, ON Work Model: Hybrid Job Type: Full-Time Salary: 110K About the Role We are looking for a Senior Machine Learning Engineer to join the AI Centre of Excellence (AI CoE) and support enterprise Machine Learning and Data Science initiatives. This... 
    Permanent employment
    Full time

    Staffmax Staffing & Recruiting

    Toronto, ON
    15 days ago
  •  ...mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise...  ...Remote, Full-time Role Overview We’re hiring a Senior Machine Learning Engineer to architect, build, and deploy high-performance machine... 
    Full time
    Contract work
    Local area
    Remote work
    Worldwide

    Fusemachines

    Toronto, ON
    17 days ago
  • $149.6k - $187k per year

     ...-immersive transportation to improve people's lives warrants modern ML utilizing peta-byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to directly impact various aspects of our core business. If you are... 
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft

    Toronto, ON
    21 hours ago
  •  ...create, apply and work with algorithms that learn and analyze data, just like the human brain. By leveraging AI and machine learning technologies, you'll help us deliver...  ...highly skilled and experienced Machine Learning Engineering Developer II to join our team. This role... 
    Full time
    Work at office
    3 days per week

    Bell Canada

    Toronto, ON
    14 hours ago
  • $45 - $70 per hour

     ...environment where you’ll collaborate with top researchers and engineers in the field. We provide opportunities for interns to make significant...  ...Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field. Proficiency in Python and... 
    Hourly pay
    Internship
    Work at office
    Local area

    Cresta

    Toronto, ON
    20 days ago
  • $143.6k - $205.2k per year

     ...About the Role: The Machine Learning team at Tubi drives the innovation behind personalized user experiences.  With the largest inventory...  .... We are seeking a highly skilled Senior Machine Learning Engineer to contribute to transformative projects in video personalization... 
    Long term contract
    Remplacement
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Tubi - Canada

    Toronto, ON
    20 days ago
  •  ...technical builders who want to have outsized impact early. Our core engineering team is looking for a hands-on ML Engineering Lead who thrives...  ...applications ~ Strong understanding of ML fundamentals (deep learning, transformers, model evaluation, tradeoffs) ~ Experience... 
    Full time
    Internship

    Saris Corporation

    Toronto, ON
    more than 2 months ago
  • $160k - $220k per year

     ...audited at scale. We are a diverse team of engineers, product managers, and designers who are...  ...our applicable plans and policies. To learn more about our Total Rewards program,...  ...Law 144, that use artificial intelligence, machine learning, or other automated processes to... 
    Internship
    Local area
    Worldwide
    Shift work

    Okta

    Toronto, ON
    7 days ago
  •  ...responsibly and at scale. What is the Opportunity?  As a Machine Learning Engineer, part of Zafin's AIOS Product team , you will build the...  ...opportunities for professional growth and career advancement. Want to learn more about what you can look forward to during your career... 
    Full time

    Zafin

    Toronto, ON
    13 days ago
  •  ...taste, and craft as much as research and engineering – shipping experiences that creatives actually...  ...~ You’re familiar with modern deep learning such as transformers, diffusion, and encoders...  ...bring ownership, urgency, curiosity, and learn fast in a startup setting ~ Strong... 
    Full time
    Work at office

    Ideogram

    Toronto, ON
    more than 2 months ago
  •  ...from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been...  ...We are looking for a motivated and passionate Machine Learning Engineers for our team. As part of this job, you will be responsible... 
    Full time
    Remote work

    Tiger Analytics

    Toronto, ON
    more than 2 months ago
  • $100k - $145k per year

    Job Description As a Senior Machine Learning Engineer , you will build and deploy production machine learning and large language model (LLM) systems...  ..., Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together. Social Impact: Make an... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Thomson Reuters

    Toronto, ON
    1 day ago
  •  ...users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers build personalized experiences to help Pinners create a life...  ...for relocation assistance. Visit our PinFlex page to learn more about our working model.   In-Office Requirement... 
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    Toronto, ON
    more than 2 months ago
  •  ...will work directly with the Director of Engineering, and the technical decisions you make will...  ...You'll work with a team of engineers, machine learning scientists, and product people who are...  ...watch them get used, and fold what you learn back into the product within days.... 
    Full time
    Manual labor
    Work at office
    2 days per week
    1 day per week

    Signal 1

    Toronto, ON
    a month ago
  • $85 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type: Contract...  ...frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks. Review model-generated implementations... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $100k per year

     ...About the Job: \ We are seeking a seasoned Machine Learning Engineer – Computer Vision \ to design, optimise, and deploy deep learning models for large -scale, real -time edge inference. In this role, you will work on the end -to -end lifecycle of computer vision... 
    Permanent employment
    Full time
    Work at office
    Local area

    Infoya

    Toronto, ON
    more than 2 months ago
  • $200k - $220k per year

     ...Machine Learning Engineer, Associate Director – AI Innovation Teams Fitch Ratings is seeking a Machine Learning Engineer to join our new AI...  ...billion-dollar strategic decisions; clear advancement paths to Principal ML Architect or AI Research Lead roles; opportunity to... 
    Long term contract
    Immediate start

    Fitch Group

    Toronto, ON
    4 days ago
  • $125.8k - $157.3k per year

    Overview Languages English Education Earned doctorate degree Computer science Computer engineering, other Electrical and electronics engineering Mechanical engineering Robotics technology/technician Experience 5 years or more Hybrid... 
    Long term contract
    Permanent employment
    Full time
    Remote work

    Vector Institute

    Toronto, ON
    5 days ago
  •  ...Principal Data Scientist – (Gen AI, Machine Learning):   Are you energized by the idea of innovating with Generative AI? Do you want to create global impact...  ...practices for scalable adoption Partner with engineering and product leadership to align data science innovation... 
    Principal
    Long term contract
    Full time
    Worldwide
    Shift work

    Extreme Networks

    Toronto, ON
    more than 2 months ago
  • $46 - $53 per hour

     ...re actively building the next-generation Machine Learning (ML) platform for low-cost, ultra-...  ...peta-byte scale data. Our Machine Learning Engineers are excited to work on these challenging...  ...and knowledge of ML libraries like scikit-learn, Tensorflow, PyTorch, Keras, MXNet, etc.... 
    Hourly pay
    Full time
    Summer work
    Internship
    Summer internship
    Work at office
    3 days per week

    Lyft

    Toronto, ON
    23 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Machine Learning Engineer, SecureAI. Be the first to apply!