AI/LLM Engineer

AI / LLM Engineer Engagement Type:

Full-time Experience:

5–8 years

Role Overview We are looking for an

AI / LLM Engineer

with hands-on experience building

agentic AI workflows

to convert written product requirements into executable test scenarios. The role focuses on

prompt engineering, agent orchestration, and structured output generation , not model training.

Key Responsibilities Design and implement

agentic workflows

that: Interpret requirement documents (PRDs, Confluence pages) Extract user behaviors and test scenarios Build

LLM-powered agents

that produce: Structured scenario representations BDD / Gherkin-formatted test cases Integrate LLM outputs with: UI automation flows (Playwright-based) Enforce: Strict output schemas Controlled behavior to avoid hallucination Iterate prompts and agent logic based on QA feedback Support demos and POC reviews

Required Skills Hands-on experience with

Large Language Models (LLMs)

such as OpenAI, Anthropic, or any similar open source models Experience building

agentic AI systems

(goal-driven, tool-using workflows) Strong proficiency in

Python Prompt engineering for structured and deterministic output Experience working with unstructured text (documents, specs)

Required Tools / Frameworks Experience Candidates should have experience with

some

of the following: Agent frameworks: LangChain LangGraph CrewAI AutoGen LLM tooling & SDKs: OpenAI SDK Anthropic SDK Azure OpenAI Structured output & validation: Pydantic / JSON Schema Function calling / tool calling Basic retrieval: Simple RAG patterns (optional, lightweight)

Nice to Have Understanding of

software testing concepts Familiarity with

BDD / Gherkin Experience working on internal developer tools or automation POCs Exposure to browser automation concepts (Playwright / Selenium)

Success Criteria Agent produces

clear, structured, and executable test scenarios Outputs are accepted by QA with minimal manual edits Demonstrates traceability from requirements → scenarios → execution

Interested candidates to share updated resumes to :

Jyotiraj.p@genisys-group.com