Gen AI Tester

About the Role : We are looking for a Gen AI Tester with 4–8 years of experience. This role is remote or hybrid and has a duration of 6 months.

Responsibilities :

Design and execute test cases for Gen AI applications (LLMs, chatbots, copilots, etc.). Validate AI outputs for relevance, coherence, factual accuracy, and bias. Automate test workflows for APIs, AI pipelines, and model integrations. Perform regression, functional, and exploratory testing of AI features. Work with developers and data scientists to refine prompts and improve model performance. Track defects, performance metrics, and maintain test documentation.

Required Skills : Gen AI / LLM Testing (OpenAI, Azure OpenAI, Anthropic, or similar) Prompt Engineering and Validation Python / Postman / API Testing (REST, JSON) Knowledge of ML workflows and data validation Familiarity with automation tools (Selenium, PyTest, Robot Framework) Agile & DevOps Environment Experience

Preferred Skills : Experience testing RAG (Retrieval-Augmented Generation) systems Exposure to AI ethics, hallucination detection, and model evaluation metrics AI-related certifications