Azure Databricks Architect
Location
Chennai / Bengaluru / Hyderabad / Nagpur / Pune
Experience
10+ Years in Data Engineering, Cloud Architecture, and Big Data Technologies
Job Summary
We are seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of enterprise-scale data and analytics platforms on Microsoft Azure. The ideal candidate will possess deep expertise in Azure Databricks, data lake architecture, ETL/ELT frameworks, cloud-native data solutions, and modern analytics platforms. This role will partner with business stakeholders, data engineers, data scientists, and solution architects to deliver scalable, secure, and high-performing data ecosystems.
Key Responsibilities
Architecture & Design
- Design and implement end-to-end data platforms leveraging Azure Databricks and Azure-native services.
- Define scalable Lakehouse architectures using Delta Lake and Medallion Architecture principles.
- Establish enterprise data models, governance frameworks, and security standards.
- Create architecture blueprints, technical roadmaps, and solution design documents.
- Drive cloud modernization and data migration initiatives.
Data Engineering & Analytics
- Design and optimize large-scale data ingestion, transformation, and orchestration pipelines.
- Develop batch and real-time streaming solutions using Databricks Structured Streaming.
- Implement data integration solutions using:
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Event Hubs
- Azure Functions
- Azure Storage Services
- Enable advanced analytics, AI, and machine learning workloads on Databricks.
Platform & Governance
- Implement data governance, lineage, cataloging, and access control strategies.
- Leverage Unity Catalog for centralized data governance.
- Establish CI/CD and DevOps practices for data engineering projects.
- Define monitoring, alerting, performance tuning, and cost optimization strategies.
- Ensure compliance with enterprise security and regulatory requirements.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
- 10+ years of experience in Data Engineering and Data Architecture.
- 5+ years of hands-on experience with Azure Databricks.
- Experience designing and deploying enterprise-scale cloud data platforms.
- Strong understanding of security, governance, and data compliance frameworks.
Preferred Certifications
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Data Engineer Professional
- Databricks Certified Solution Architect
- Databricks Certified Machine Learning Professional
