AI/LLM Engineer

AI / LLM Engineer

Engagement Type: Full-time

Experience: 5–8 years

Role Overview

We are looking for an AI / LLM Engineer with hands-on experience building agentic AI workflows to convert written product requirements into executable test scenarios. The role focuses on prompt engineering, agent orchestration, and structured output generation, not model training.

Key Responsibilities

- Design and implement agentic workflows that: - Interpret requirement documents (PRDs, Confluence pages) - Extract user behaviors and test scenarios - Build LLM-powered agents that produce: - Structured scenario representations - BDD / Gherkin-formatted test cases - Integrate LLM outputs with: - UI automation flows (Playwright-based) - Enforce: - Strict output schemas - Controlled behavior to avoid hallucination - Iterate prompts and agent logic based on QA feedback - Support demos and POC reviews

Required Skills

- Hands-on experience with Large Language Models (LLMs) such as OpenAI, Anthropic, or any similar open source models - Experience building agentic AI systems (goal-driven, tool-using workflows) - Strong proficiency in Python - Prompt engineering for structured and deterministic output - Experience working with unstructured text (documents, specs)

Required Tools / Frameworks Experience

Candidates should have experience with some of the following:

- Agent frameworks: - LangChain - LangGraph - CrewAI - AutoGen - LLM tooling & SDKs: - OpenAI SDK - Anthropic SDK - Azure OpenAI - Structured output & validation: - Pydantic / JSON Schema - Function calling / tool calling - Basic retrieval: - Simple RAG patterns (optional, lightweight)

Nice to Have

- Understanding of software testing concepts - Familiarity with BDD / Gherkin - Experience working on internal developer tools or automation POCs - Exposure to browser automation concepts (Playwright / Selenium)

Success Criteria

- Agent produces clear, structured, and executable test scenarios - Outputs are accepted by QA with minimal manual edits - Demonstrates traceability from requirements → scenarios → execution

Interested candidates to share updated resumes to : Jyotiraj.p@genisys-group.com