AI Gateway Engineer

About the Company

We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.

About the Role

Key Responsibilities:

Design and manage AI/API gateways like Kong, Mosaic, or Portkey. Develop and maintain backend services, primarily using Go, with Python as a valuable secondary skill. Optimize and productize AI/ML models for production use, ensuring performance, scalability, and reliability. Leverage AWS to build and manage our cloud infrastructure. Implement and manage observability tools, including OpenTelemetry (OTel), Grafana, and Prometheus, to monitor system health and performance. Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models. Collaborate with cross-functional teams to ensure seamless integration and deployment of AI solutions.

Qualifications

Proven experience with API or AI gateways (e.g., Kong, Mosaic, Portkey). Strong backend development skills, particularly in Go; proficiency in Python is a plus. Experience with AI/ML optimization and productization. Expertise in AWS, including its various services for building scalable applications. Familiarity with observability tools like OTel, Grafana, and Prometheus. Practical experience with prompt engineering. A history of working in enterprise-grade environments.

Required Skills

API or AI gateways experience. Backend development in Go. AI/ML optimization. AWS expertise. Observability tools knowledge. Prompt engineering experience.

Preferred Skills Proficiency in Python and Golang Experience in enterprise-grade environments.

Location: Remote (preferred in LATAM region) Length: 1+ Year Client: Gaming Giant

The difference between something good and something great is attention to detail – AVM Consulting.