GCP - Data Engineer/ Senior Data Engineer/Lead Data Engineer (3 –13 yrs Experience) - Kolkata

About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from their analytics investments. The aim is to bridge the gap between insight delivery and value realization by providing customers with a differentiated approach to data and analytics through tailor-made solutions.

We’re focused on bridging the gap between insights delivery and value realization, partnering with our clients to help them cross the last mile gap in analytics. This DNA pushes our ecosystem to go beyond possible, helping our clients re-think their limitations and overcome their norms of ‘possible’.

Role –

GCP Staff Data Engineer Experience: 3 - 13 + years Preferred - Data Engineering Background Location –Bangalore, Chennai, Hyderabad, Kolkata, Pune, Gurgaon Required Skills - GCP DE Experience, Big query, SQL, Cloud compressor/Python, Cloud functions, Dataproc+pyspark, Python injection, Dataflow+PUB/SUB , DBT

Job Requirement: - Design, build, and optimize end-to-end data pipelines using GCP Composer, BigQuery, BigTable, DataFlow, DataProc, and DataStore. - Develop and maintain efficient, reusable, and reliable Python and SQL code for data ingestion, transformation, and storage. - Implement DevOps practices for continuous integration, deployment, and monitoring of data workflows on GCP. - Collaborate with cross-functional teams to understand data requirements and translate them into scalable technical solutions. - Troubleshoot and resolve data-related issues, ensuring high availability and performance of data infrastructure. - Document data engineering processes, workflows, and best practices to promote knowledge sharing.

You will need: - Possess a BE/BTech degree in Computer Science, Information Technology, or a related field. - Have 3 to 12 years of hands-on experience in data engineering, preferably within the retail domain. - Demonstrate advanced proficiency in Google Cloud Platform services including Composer, BigQuery, BigTable, DataFlow, DataProc, and DataStore. - Exhibit strong programming skills in Python and SQL for data processing and pipeline development. - Apply DevOps methodologies to automate deployments and monitoring within a cloud environment. - Show strong problem-solving skills and the ability to work effectively in a hybrid team setting. Good to Have Skills: - Possess certifications in Google Cloud Platform (e.g., Professional Data Engineer). - Experience with containerization technologies such as Docker and orchestration tools like Kubernetes. - Familiarity with other cloud platforms or big data technologies outside GCP. - Knowledge of machine learning workflows integration with data pipelines. - Understanding of retail industry data standards and metrics.