Data Quality Engineer

About Position:

We are looking for a highly skilled Data Quality Engineer (Data QE) with strong experience in validating data pipelines, automation testing, and ensuring end‑to‑end data reliability across ETL/ELT processes. The ideal candidate will have hands-on experience in Python-based test automation, data ingestion testing, and exposure to cloud data platforms such as Databricks.

- Role: Data Quality Engineer - Location: All Persistent Location - Experience: 6+ Years - Job Type: Full Time Employment

What You'll Do:

- Perform comprehensive Data Quality (DQ) validations on ETL/ELT pipelines, including transformation logic, schema validation, and data reconciliation. - Execute data ingestion testing across multiple sources such as APIs, databases, files, and streaming systems. - Validate data flows on Databricks-based ETL frameworks leveraging notebooks, jobs, and cluster executions. - Design and develop automation test suites using Python and Pytest for data validations, DQ rule enforcement, and regression testing. - Integrate automation frameworks into CI/CD pipelines. - Build reusable DQ scripts and utilities to ensure data consistency and stability throughout the pipeline. - Perform API testing for ingestion and consumption layers using data-focused validation frameworks. - Validate API responses, data structures, and end-to-end integration with downstream systems. - Work with Databricks notebooks, data workflows, and jobs for validating ETL pipelines. - Familiarity with Databricks Genie or similar AI-driven productivity tools for code enhancement and debugging. - Collaborate with data engineering teams to troubleshoot and optimize data workflows.

Expertise You'll Bring:

- 6+ years of experience in Data Quality Engineering or Data Testing roles. - Strong experience in data ingestion testing, API testing, and DQ validation. - Hands-on expertise in Python, Pytest, and automation frameworks. - Working knowledge of Databricks environment, notebooks, and job execution. - Proficiency in SQL for complex data validation and reconciliation.

Benefits:

- Competitive salary and benefits package - Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications - Opportunity to work with cutting-edge technologies - Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards - Annual health check-ups - Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

- We support hybrid work and flexible hours to fit diverse lifestyles. - Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. - If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."