Senior AI Engineer, AI Inference Systems

Senior AI Engineer, AI Inference Systems Location: Palo Alto, CA (Pacific Time, UTC-08:00). Compensation: $250k‑350k USD/year plus equity.

Overview Founded by a team of Cambridge ex‑quant traders and researchers, Chai serves over 5 trillion tokens per month to 5 million users. The startup is among the fastest‑growing in Palo Alto, rapidly scaling its AI platform.

Team Culture Our leadership promotes a high‑velocity, hard‑working environment focused on reliability and high standards. We value autonomy and expect each team member to contribute proactively through engagement and innovation.

About The Company Chai – US, 1‑50 employees, Seed Round, Software services.

Responsibilities We need a relentless engineer with 3+ years of experience overseeing and being responsible for optimizing our LLM inference engine. Ensure it is performant, scalable, and cost‑efficient. You will work alongside equally talented and driven teammates implementing cutting‑edge AI inference engines. We need someone who is reliable and has high standards.

Why You Might Not Be the Right Fit

We work hard and have a high‑velocity environment with lots of growth opportunities.

We value exceptional performance and continuous improvement. We believe that if you aren’t constantly learning, you aren’t growing.

You will be responsible and accountable for making high‑impact decisions that determine Chai’s future.

Why You Should Join Us

Exponential growth: 1 Million MAU, growing toward 100 Million MAU.

Craftsmanship: Build something beautiful.

Requirements

Familiar with vLLM, quantization, and current techniques of LLM optimization.

3+ years of experience in software engineering.

Bachelor or Master’s degree from a leading academic institution.

Tech Stack

Front end: Python, Flutter, Dart.

Back end: Python, GCP, Redis, Kubernetes.

Interview Process

AI interview

Code assessment

Technical assessment

On‑site interview

Offer negotiation

#J-18808-Ljbffr