Principal Machine Learning Engineer, SecureAI
$192k - $264k per yearOkta
Secure Every Identity, from AI to Human
Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.About Okta Secures AI Team
The Okta for AI Agents Team is building the future of digital identity management. The way companies are using agents and allowing them access is undergoing a fundamental shift, enabling teams to move fast while staying secure.
Our North Star is clear: To get AI right, you have to get identity right. We are not just managing identities; we are building the industry's first Identity Security Fabric for the agentic era. As organizations rapidly deploy AI, these non-human entities are acting with access to critical tools, often bypassing traditional perimeters and creating a 'Shadow AI' crisis. Our mission is to move identity from a reactive gatekeeper to a unified control plane, transforming AI risk into business ROI.
We are tackling this by implementing a comprehensive four-pillar maturity model: Discover, Onboard, Protect, and Govern. We are driving innovation by defining the standards for Agentic Identity—including pioneer work with securing AI Agents and support for protocols like MCP. You will be helping us build the infrastructure that allows enterprises to scale AI safely, ensuring every access decision—whether made by a human or an automated agent—is authenticated, authorized, and audited at scale.
We are a diverse team of engineers, product managers, and designers who are bringing Okta’s expertise in identity to define the future of Agent Identity management, focusing on enablement while staying secure.
About the role
In this role, you will join the Agent Access Policies sub-team under Okta Secures AI as a Principal Machine Learning (ML) Engineer to advance Okta's authorization capabilities. By replacing static, rule-based systems with dynamic AI security mechanisms, you will deliver real-time threat inspection, agent intent evaluation, and behavioral analysis—ensuring autonomous AI agents operate safely within specified bounds.
Your core mission will be architecting and driving features for our unified control plane to establish the premier Identity Security Fabric for the agentic era. In doing so, you will help execute our guiding principle: "To get AI right, you have to get identity right."
What you’ll be doing
- Implement intent-based enforcement to verify agent runtime requests match their intended purpose, requiring key capabilities.
- Apply LLM reasoning and prompt parsing to interpret prompts, tool payloads, and intent in real time.
- Integrate low-latency inference or semantic evaluation engines directly into the API gateway request path.
- Use embeddings, vector search, or zero-shot classification to score alignment between agent intent and executed actions.
- Design confidence-scored decision engines that feed semantic verification results into policy frameworks (e.g., Cedar).
- Establish evaluation benchmarks, prompt injection defenses, and guardrails to prevent bypasses or false positives.
- Architect scalable ML and Generative AI systems integrating retrieval, inference, and evaluation pipelines.
- Optimize prompting, context retrieval, and RAG workflows for accuracy, safety, and efficiency in Claude-based systems.
- Build automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
- Implement schema validation, structured output enforcement, and guardrails to ensure reliable, compliant AI outputs.
- Mentor and coach engineers to support team and community growth.
What you’ll bring to the role
- 10+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
- Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
- Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
- Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
- Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
- Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
- Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
- Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
- Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.
Extra credit
- Experience integrating AI-driven systems with identity, authentication, or security products.
- Exposure to ethical AI, model risk, or compliance frameworks.
- Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
Education:Bachelor’s or Master's degree in Computer Science or related field
(P25822_3552624)
#LI-Hybird
#LI-BB1
Below is the annual base salary range for candidates located in San Francisco Bay Area. Your actual base salary will depend on factors such as your skills, qualifications, experience, and work location. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program please visit: .
The annual base salary range for this position for candidates located in the San Francisco Bay area is between: $192,000—$264,000 CADThe Okta Experience
We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.
Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation. Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.$140k - $192.5k per year
...advertising and marketing channels. We're looking to add a Machine Learning Engineer to our Data Science team! This team works on solving... ...candidates based in Canada and the United States. Want to learn more about our Data Science Team: Learn more about our team...SuggestedLocal areaRemote workWork from homeHome office- ...for this role. : The goal of the ML Engine team is to enable training and deploying... .... We are looking for experienced Senior Machine Learning Engineers (engineering lead) who have... ...development, and reward and recognition programs. Learn more Additional Information: We're...SuggestedFull timeWork from home
$168k - $231k per year
...audited at scale. We are a diverse team of engineers, product managers, and designers who are... ...our applicable plans and policies. To learn more about our Total Rewards program,... ...Law 144, that use artificial intelligence, machine learning, or other automated processes to...SuggestedLong term contractLocal areaWorldwideShift work- ...It all started when engineer Fred Luddy wrote code that automated a tedious task for... ...people. Job Description The Machine Learning Developer designs, builds, ships, and operates... ...authored. The Developer builds the engine behind ServiceNow's optimization products...SuggestedFull timeWork at officeLocal areaImmediate startRemote workFlexible hours
$400k per year
...Job Description: Position: Machine Learning Engineer Location: Remote / Hybrid Employment Type: Full-time Responsibilities Design, train... ...in Python and ML frameworks (TensorFlow, PyTorch, Scikit-learn). Experience with cloud platforms (AWS, GCP, Azure) and containerization...SuggestedFull timeRemote workRelocation- ...We are looking for a Machine Learning Engineer to join our Toronto team and help us take our products to the next level in terms of visual intelligence... ...with frameworks such as PyTorch, TensorFlow and scikit-learn Practical knowledge of CNNs and modern computer vision architectures...Full timeInternshipManual laborWork at office3 days per week
- ...effective, secure, and reliable. This role will involve hands-on work on cutting-edge projects, requiring innovative and passionate machine learning engineers who can bring research into practical, scalable applications. As a Machine Learning Engineer, your goal will be to take...Full timeManual laborWork at officeLocal areaRemote workWork from homeHome office
$149.6k - $187k per year
...-immersive transportation to improve people's lives warrants modern ML utilizing peta-byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to directly impact various aspects of our core business. If you are...Hourly payWork at officeFlexible hours3 days per week$160k - $220k per year
...audited at scale. We are a diverse team of engineers, product managers, and designers who are... ...our applicable plans and policies. To learn more about our Total Rewards program,... ...Law 144, that use artificial intelligence, machine learning, or other automated processes to...InternshipLocal areaWorldwideShift work- ...experience, Thri5 is venture-backed by some of Canada's most prominent VC and angel investors. Your Role As an AI / Machine Learning Engineer at Thri5, you'll help build the agent layer that powers our System of Actions. You'll design and implement multi-agent Co...Full time
- ...from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been... ...We are looking for a motivated and passionate Machine Learning Engineers for our team. As part of this job, you will be responsible...Full timeRemote work
$170k per year
...dedicated group of recommendations, search, applied research and ML engineers working full time on discovery for Everand and Fable. The... ...and Everand. Role Overview We're looking for a Senior Machine Learning Engineer to own recommendations for Fable and grow into the technical...Long term contractFull timeFor contractorsLocal areaHome officeFlexible hours$100k - $145k per year
Job Description As a Senior Machine Learning Engineer , you will build and deploy production machine learning and large language model (LLM) systems... ..., Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together. Social Impact: Make an...Full timeWork at officeLocal areaRemote workFlexible hours- ...mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise... ...Remote, Full-time Role Overview We’re hiring a Senior Machine Learning Engineer to architect, build, and deploy high-performance machine...Full timeContract workLocal areaRemote workWorldwide
$220k - $260k per year
...Machine Learning Engineer, Associate Director – AI Innovation Teams Fitch Ratings is seeking a Machine Learning Engineer to join our new AI... ...billion-dollar strategic decisions; clear advancement paths to Principal ML Architect or AI Research Lead roles; opportunity to...Long term contractImmediate start$150k - $200k per year
...Senior Machine Learning Engineer – AI Innovation Teams As one of the world’s top three credit ratings agencies, Fitch Ratings plays a critical... ...ML architects, and clear paths to Lead ML Engineer or Principal ML Engineer roles; build a reputation as a go-to expert in...Long term contractInternshipManual laborImmediate start$168k - $231k per year
...audited at scale. We are a diverse team of engineers, product managers, and designers who are... ...our applicable plans and policies. To learn more about our Total Rewards program,... ...Law 144, that use artificial intelligence, machine learning, or other automated processes to...Long term contractLocal areaWorldwideShift work$186.1k - $265.8k per year
...About the Role: The Machine Learning team at Tubi drives the innovation behind personalized user experiences. With the largest inventory... .... We are seeking a highly skilled Senior Machine Learning Engineer to contribute to transformative projects in video personalization...Long term contractRemplacementFull timeTemporary workWork at officeLocal areaRemote workFlexible hours$45 - $70 per hour
...environment where you’ll collaborate with top researchers and engineers in the field. We provide opportunities for interns to make significant... ...Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field. Proficiency in Python and...Hourly payInternshipWork at officeLocal area$110k per year
...The Senior Machine Learning Engineer will support the AI CoE's Machine Learning and Data Science initiatives by building, deploying, and operationalizing end-to-end machine learning solutions in cloud environments. The role is highly technical and hands-on, with ownership...Full time$181.36k - $272.04k per year
...justice . Summary: We are currently seeking a Manager, Machine Learning Engineering to join our rapidly growing engineering organization. This... ..., and full stack developers across a variety of projects Learn new things, challenge yourself, and hone your craft as an ML...Work at officeLocal areaRemote workFlexible hours$100k - $145k per year
...Thomson Reuters is seeking a Senior Machine Learning Engineer who will create the machine learning solutions development and technical implementation... ...a plus. Familiarity with Spark, Airflow, PyTorch, Scikit-learn, Pandas, Keras, and other relevant ML libraries....RemplacementFull timeWork at officeLocal areaFlexible hours- ...curious, accountable, eager to learn, and supportive of their... ...level, hands-on software and ML engineering professional for an embedded,... ...and sits between Senior and Principal level. There are no direct reports... ...and operationalizing machine learning models in production...Full time
- ...Recognized as a top kids' wearable by PCMag and others, Cosmo is on the rise. About the Role Department: Engineering Role Summary: We are looking for a Principal Engineer to set the technical direction for our Android platform and raise the engineering bar across the...PrincipalFull timeInternshipRemote work
$14.13k per year
...Course number and title : CSC2515HS - Introduction to Machine Learning Please note, this position is a 0.5 FCE appointment.... ...Machine learning (ML) is a set of techniques that allow computers to learn from data and experience, rather than requiring humans to specify...Long term contractWork at office- ...Principal Software Engineer The global capital markets are among the largest markets in the world valued... ...By fostering a culture of continuous learning and skill development, we prepare our... ...Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together. Social...PrincipalLong term contractFull timeWork at officeLocal areaFlexible hours
- ...changes spanning the catalogue. Align engineering, product, security, infrastructure,... ...environments such as FedRAMP, FIPS, or PCI, prior Principal or Distinguished IC work, and enterprise... ...to US$100 net per month. Annual learning and development stipend for conferences,...PrincipalFull timeRemote workWork from homeHome officeFlexible hours
$180k - $220k per year
...Xello is looking for a Principal Engineer Please note that this is a remote role open to candidates across Canada, with working hours aligned... ...with leading technologies, we are committed to continuous learning and growth through internal/external training and mentoring,...PrincipalLong term contractFull timeRemote workFlexible hours- ...Job Responsibility: Principal Mechanical Engineer - TOR0030 Company : Worley Primary Location : CAN-ON-Toronto Job : Mechanical Schedule : Full-time Employment Type : Employee Job Level : Experienced Job Posting : Nov 27 Unposting Date : Dec 27 Reporting...PrincipalFull timeInternshipWork at officeLocal area
$92.1k - $153.5k per year
...Job Responsibility: Permanent Full Time Canada Life is seeking a Principal Engineer (Director level) to drive our adoption of Cloud. This role will be pivotal in building and operationalizing modern, cloud platforms and applications. The successful candidate will combine...PrincipalPermanent employmentFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Machine Learning Engineer, SecureAI. Be the first to apply!
- chief power engineer Toronto, ON
- director software engineering Toronto, ON
- mechanical engineering project manager Toronto, ON
- general engineer Toronto, ON
- mechanical engineering director Toronto, ON
- engineering project manager Toronto, ON
- chief engineer Toronto, ON
- directeur ingénierie Toronto, ON
- project engineer assistant project manager Toronto, ON
- conseiller principal d'éducation Toronto, ON
