Manual QA Engineer (Middle) ID51808

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE We are looking for a Manual QA Engineer

to ensure the quality and reliability of web applications and AI-driven features in an Agile environment. This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases. You’ll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes.

WHAT YOU WILL DO - Perform manual testing of web applications to identify bugs, glitches, and inconsistencies; - Develop, maintain, and execute detailed manual test cases based on product requirements and specifications; - Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.; - Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements; - Design and execute test scenarios to verify AI behavior, including prompt–response consistency, contextual relevance, and deterministic vs. non-deterministic outputs; - Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate); - Conduct manual API testing to validate request/response accuracy, error handling, and integration; - Use TestRail to create, manage, and track test plans, test cases, and test execution results; - Use Jenkins CI/CD pipelines; - Report and document defects clearly using the bug tracking system (JIRA); - Participate in daily stand-ups, sprint planning, and other Agile team meetings; - Review user stories and acceptance criteria to understand the scope of testing; - Estimate own tasks, report on risks to the team lead; - Collaborate with developers and other QA team members to reproduce issues and verify fixes; - Maintain and update test documentation as needed.

MUST HAVES -

2+ years of experience with manual testing ; - Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models; - Knowledge of Testing and Quality Assurance Processes; - Strong experience with Test Design activities to cover a set of product requirements; - Knowledge of Test Design techniques; - Knowledge of testing methodologies; - Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes; - Experience with

Postman

(API testing) and Browser developer tools; - Experience with

UI testing; - Understanding of

LLM evaluation principles,

including prompt engineering, output validation, and model fine-tuning cycles; - Familiarity with AI/ML concepts, APIs, and frameworks (e.g.,

OpenAI API, Azure OpenAI, LangChain ); - Knowledge of data protection and compliance standards for

AI systems

(GDPR, zero-data retention, PII anonymization); - Experience with

TestRail

as a Test Management system (as a user, test execution is required); - Basic understanding of CI/CD process; -

Upper-intermediate English level .

NICE TO HAVES - Experience with SSO testing; - Experience in Performance or Load.

PERKS AND BENEFITS -

Professional growth:

Mentorship, TechTalks, and personalized growth roadmaps. -

Competitive compensation:

USD-based pay with education, fitness, and team activity budgets. -

Exciting projects:

Modern solutions with Fortune 500 and top product companies. -

Flextime:

Flexible schedule with remote and office options.

Meet Our Recruitment Process It includes main stages: Application → Coding Challenge → Video Interview → Technical Interview or Interview with the Hiring Manager(s). Each step helps us understand your skills and overall fit. If it’s a match, you’ll receive an offer.