Senior Data Engineer

Location:

Mumbai, Maharashtra (Onsite) Experience:

5+ years Employment Type:

Full-time

About the Role: We’re seeking a Senior Data Engineer with deep expertise in large-scale data scraping and end-to-end data architecture design. This role focuses on building the backbone of our AI-driven systems—from developing responsive, semantic scraping frameworks to architecting robust, scalable data pipelines from the ground up. You’ll play a key role in ensuring that our data infrastructure is intelligent, efficient, and future-ready.

Key Responsibilities: Design and implement scalable web scraping systems capable of handling high-volume, high-velocity data sources. Develop responsive and semantic scraping solutions using advanced AI and NLP methods to extract meaningful, context-rich information. Architect and build data pipelines from scratch, integrating structured and unstructured data across multiple platforms. Establish reliable, fault-tolerant data architectures for long-term scalability and maintainability. Integrate scraped data into RAG (Retrieval-Augmented Generation) and other intelligent workflows. Continuously enhance scraping performance, pipeline efficiency, and data quality through automation and innovation.

Required Skills and Qualifications: 5+ years of experience in data engineering, data scraping, and pipeline development. Proven track record of building end-to-end data systems from the ground up. Deep knowledge of web scraping tools (Scrapy, Selenium, BeautifulSoup) and anti-blocking, concurrent scraping strategies. Strong understanding of AI-driven data extraction, NLP, and semantic enrichment. Experience implementing RAG pipelines and integrating LLMs with retrieval systems. Familiarity with cloud infrastructure (AWS/GCP/Azure) and CI/CD best practices.

Why Join Us: Build cutting-edge, AI-powered data scraping ecosystems at production scale. Shape the data architecture roadmap for next-generation intelligent systems. Collaborate with a highly skilled, forward-thinking engineering team. Competitive salary, challenging projects, and high growth potential.

If you’re passionate about turning large-scale web data into meaningful, AI-ready insights, we want you on our team.