Senior Databricks Engineer

Job Title:

Databricks Engineer (Remote) Location:

100 % Remote Job Type:

Full-Time Shift timings : 3 pm - 11 pm IST

About the Role: We are looking for an experienced

Databricks Engineer

with a strong background in

data engineering

to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. You'll work with cross-functional teams to create robust data pipelines and ensure the reliability, quality, and observability of data across platforms.

Key Responsibilities Design, develop, and maintain

data pipelines

and ETL processes on

Databricks . Lead the architecture and implementation of

scalable, secure, and high-performance

data solutions. Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions. Optimize data workflows for

performance, cost-efficiency, and reliability . Integrate data from multiple structured and unstructured sources into

Delta Lake

and cloud data warehouses. Implement

best practices

in data governance, security, and quality management. Mentor junior engineers and provide

technical leadership

in data engineering best practices. Troubleshoot and resolve issues in data pipelines, ensuring

high data availability and integrity .

Required Skills & Experience 6-7 years

of experience in

Data Engineering . Proven

Subject Matter Expertise

in

Databricks

(including Databricks SQL, Delta Lake, and MLflow). Strong experience with

PySpark ,

Spark SQL , and

Scala . Hands-on experience with

cloud platforms

(Azure preferred; AWS/GCP a plus). Proficiency in

data modeling, ETL development , and

data warehousing

concepts. Solid understanding of

big data ecosystems

(Hadoop, Kafka, etc.). Strong SQL development skills with a focus on

performance tuning . Experience in implementing

CI/CD pipelines

for data solutions.