Senior AI/ML Engineer - Intelligence Accelerator

Senior AI/ML Engineer - Intelligence Accelerator Join to apply for the Senior AI/ML Engineer - Intelligence Accelerator role at Okta for Developers.

About The Role

The Intelligence Accelerator team in the Data Platform Group is the engine behind Okta’s AI/ML evolution. We build the foundational AI/ML services and systems that fast‑track AI/ML for Okta and deliver differentiated value to our users. Working hand‑in‑glove with the Data Platform team, Data Scientists, Product Managers, and the SREs, you will bridge the gap between data, research and platform offerings, playing a critical role in enabling the technical adoption of ML and Generative AI across the company.

Key Responsibilities

Contribute to building scalable infrastructure for core machine learning lifecycles, including distributed training clusters, real-time inference serving, and high‑performance feature stores.

Implement Agentic Infrastructure, working on the bleeding‑edge stack for Agentic AI, and help implement standards like the Model Context Protocol (MCP) to securely connect LLMs with internal tools, data, and APIs.

Build internal developer tooling that allows product engineering teams to leverage Generative AI workflows, RAG pipelines, and vector databases without worrying about the underlying infrastructure.

Design, build, and maintain robust, scalable ML infrastructure using modern tools (Airflow, MLFlow, feature stores, vector databases) while implementing automated CI/CD workflows for model training, validation, and deployment.

Evaluate and adopt new ML technologies while ensuring data security, privacy, and compliance within the ML infrastructure.

Design and maintain pipelines to ingest, process, and transform data from various sources, ensuring data quality, security, and compliance of data feeding into ML models and offline model artifact deployment.

Deploy and monitor ML systems with data scientists and engineers, troubleshoot infrastructure issues, and optimize performance.

Collaborate and evangelize with cross‑functional teams to align AI/ML platform strategies with company objectives and provide mentorship to analysts and stakeholders.

Qualifications

5+ years of software engineering experience focused on backend systems, distributed computing, or cloud infrastructure (AWS, GCP, Azure).

Experience building and scaling ML platforms using Kubernetes, Ray, Kubeflow, or similar orchestration tools.

Track record of implementing CI/CD pipelines, automated testing, and observability for Machine Learning workloads.

Familiarity with the modern LLM stack (LangChain, vector databases, RAG patterns) and interest in emerging standards such as Model Context Protocol (MCP) and Agentic workflows.

Expert‑level proficiency in Python and familiarity with Go, Java, or C++.

Collaborative experience working directly with Data Scientists or Applied AI teams to translate research needs into robust production systems.

Nice to Have

Experience with Java and/or Java EE web applications.

Familiarity with authentication protocols, access management, or cloud security best practices.

Exposure to prompt engineering, LLM ecosystems (Hugging Face, LangChain, vector databases), and identity and access management or security focused ML applications.

In-person orientation in Toronto first week of work.

Annual base salary for candidates located in the San Francisco Bay Area ranges from $130,000—$194,000 CAD. Additional compensation includes equity (where applicable), bonus, and benefits such as health, dental, vision insurance, 401(k), flexible spending account, and paid leave.

What you can look forward to as a Full‑Time Okta employee

Amazing benefits.

Making social impact.

Developing talent and fostering connection + community at Okta.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding, please use this Form to request an accommodation. Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Personnel and Job Candidate Privacy Notice.

#J-18808-Ljbffr