Analytics Architect - Azure Databricks / Fabric

Analytics Architect – Azure Databricks / Microsoft Fabric Responsibilities Lead the architecture, design and implementation of advanced analytics solutions using

Azure Databricks

and

Microsoft Fabric

. Partner closely with business stakeholders and cross-functional IT teams to translate requirements into scalable analytics platforms. Own the end-to-end delivery of data solutions, ensuring adherence to architectural standards, security, governance and best practices. Design, build and optimize data ingestion pipelines and ETL/ELT frameworks using

Azure Databricks, PySpark and Azure Data Factory

. Integrate Databricks with

Azure Data Lake Storage Gen2, Azure Synapse, Microsoft Fabric

and on-premise systems. Provide technical leadership and mentorship to data engineering teams, promoting continuous improvement and innovation. Maintain comprehensive documentation of architecture, data flows and operational processes. Enforce best practices around code quality, performance optimization, scalability and data security. Stay current with Databricks and Azure analytics advancements to continuously evolve the platform.

Essential Skills Extensive hands-on experience with

Azure Databricks

, including cluster management, notebooks and

Delta Lake

. Strong proficiency in

PySpark

, Spark and big data technologies (Hadoop ecosystem). In-depth knowledge of

Azure Data Lake, Azure Synapse, Azure Data Factory

, Power BI, SSRS, SSAS and SKU transitions (PSKU to F SKU). Expertise in building data lakes, data warehouses and large-scale ETL/ELT pipelines. Advanced

SQL

skills with familiarity in NoSQL databases. Experience with

CI/CD pipelines

, Git and modern DevOps practices. Solid understanding of cloud security and governance principles.

Soft Skills Excellent communication skills, with the ability to articulate complex technical concepts to business stakeholders. Strong analytical and problem-solving mindset with a proactive approach to risk mitigation. Proven leadership and mentoring capabilities.

Nice to Have Advanced experience with

Power BI

for reporting and analytics. Knowledge of

Microsoft Fabric

for analytics and integration workloads. Experience with

Spark Streaming

for real-time data processing. Familiarity with

Azure Resource Manager (ARM) templates

and Infrastructure as Code practices.

Experience Requirements 12+ years of experience building data ingestion and transformation pipelines using

Databricks, Synapse Notebooks and Azure Data Factory

. Hands-on expertise with

Delta Tables, Delta Lake and ADLS Gen2

. Experience using

Auto Loader

and

Delta Live Tables

for scalable data ingestion. Proven ability to build and optimize query layers using

Databricks SQL

. Demonstrated integration of Databricks with

Azure Synapse, ADLS Gen2 and Power BI

for end-to-end analytics solutions. Prior experience designing, optimizing and deploying

Power BI dashboards and reports

. Strong exposure to modern

CI/CD frameworks

within Databricks and cloud-native environments.