Job Description
Senior Data Architect
100% Remote
Fulltime Permanent Role
Exp: 9+ Years
Immediate- max 15 Days Joiners !!!
Job Summary
Our client is building a modern, enterprise-grade, multi-cloud data estate using a Databricks Lakehouse platform that consolidates data across AWS, Azure, GCP, and on-prem systems.
The Senior Data Architect will lead the design, governance, and implementation strategy of this unified data platform. This is a high-impact technical leadership role responsible for defining architecture standards, ensuring governance and security compliance, and enabling scalable analytics, reporting, and AI/ML capabilities.
Requirements :
Key Responsibilities
1. Strategic Architecture & Design
· Design the enterprise architecture for the Databricks Lakehouse, including medallion architecture (Bronze, Silver, Gold) and semantic layers.
· Develop multi-cloud data ingestion and consolidation strategies across AWS, Azure, GCP, and on-prem systems.
· Define standards for data lineage, metadata management, data quality, CDC/SCD, streaming, and batch ingestion.
· Establish enterprise data governance frameworks, including classification, cataloging (Unity Catalog), retention, and security policies.
· Ensure compliance with global regulatory standards such as GDPR, PIPEDA, Australian Privacy Act, and SOC 2.
· Architect scalable, reliable, and cost-efficient solutions to support analytics, reporting, GIS, and AI/ML workloads.
· Create architecture documentation, standards, and best practices.
2. Implementation Leadership & Engineering Partnership
· Collaborate with data engineering teams to implement pipelines, Delta Lake storage, and Databricks workflows.
· Provide technical leadership, architectural guidance, and code reviews.
· Ensure consistent architecture implementation across products, tenants, and cloud environments.
· Work with DevOps teams on infrastructure, networking, identity management, and CI/CD integration.
· Establish monitoring, observability, and operational governance processes.
3. Data Governance, Security & Compliance
· Define and enforce security policies including RBAC/ABAC, encryption, and audit logging.
· Integrate enterprise metadata and lineage using Unity Catalog and Purview.
· Ensure compliance with data residency, regulatory, and cloud-specific requirements.
· Develop standards for data retention, archival, and disaster recovery.
4. Analytics, AI/ML & Product Enablement
· Design architecture supporting BI tools such as Power BI and Databricks SQL.
· Enable advanced analytics, predictive modeling, geospatial analytics, and AI/ML use cases.
· Establish semantic modeling standards to ensure consistent business definitions across products.
5. Leadership & Collaboration
· Serve as a subject matter expert in Databricks Lakehouse and multi-cloud data architecture.
· Mentor engineering teams on data modeling, governance, and scalable architecture practices.
· Collaborate with product teams and stakeholders to translate business requirements into technical solutions.
· Participate in architectural governance, vendor evaluations, and roadmap planning.
Skills & Experience
Required:
· 8+ years of experience in data architecture, data engineering, or platform architecture, including 3+ years in a senior or leadership role.
· Strong expertise in Databricks (preferably Azure), including Delta Lake, Unity Catalog, SQL Warehouses, and Lakehouse architecture.
· Experience designing multi-cloud or hybrid architectures across AWS, Azure, and GCP.
· Expertise in medallion architecture, metadata management, and enterprise data governance.
· Advanced SQL skills and experience with Python, Scala, PySpark, or Spark SQL.
· Experience with CDC, SCD Type 1/2, streaming pipelines, and batch processing.
· Strong knowledge of security, compliance, encryption, and data governance standards.
· Excellent documentation, communication, and architectural design skills.
Preferred:
· Experience integrating Unity Catalog with Purview or similar metadata tools.
· Knowledge of AI/ML, geospatial analytics, or predictive modeling platforms.
· Experience with Power BI semantic modeling or enterprise BI architecture.
· Experience in regulated or multi-tenant data environments.
· Relevant certifications such as Databricks Architect, Azure Data Architect, or AWS/GCP certifications.
EDUCATION
· Bachelor’s or master’s degree in computer science, Software Engineering, or a related field, or equivalent professional experience.