Data Engineer - Azure Databricks
- Posted a month ago
- Be among the first 40 applicants
Job Description
About Tarento
Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.
Senior Data Engineer (Azure Databricks)
Lead design and architecture of large-scale data infrastructure and pipelines (Data Lakehouse).
Transform complex business requirements into automated, secure data solutions (ETL/ELT) primarily in Azure.
Optimize data storage and compute costs across Databricks clusters and Data Lake.
Troubleshoot and resolve production pipeline failures and data quality issues.
Drive best practices in data governance, security, and pipeline reliability.
Mentor and coordinate with global teams (data scientists, analysts, operations).
Required Skills & Experience
5–8 years (often 8+ in practice) in data engineering or platform roles.
Expert hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Deep SQL and data modelling skills (OLAP, OLTP, dimensional modelling).
Proficiency in Python/Scala for Spark jobs and data transformation.
Understanding of Azure Data Lake Storage optimizations and Azure resource cost tuning.
Experience implementing CI/CD and IaC for data pipelines.
Knowledge of data security/compliance (RBAC, encryption, GDPR principles).
Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.
Senior Data Engineer (Azure Databricks)
Lead design and architecture of large-scale data infrastructure and pipelines (Data Lakehouse).
Transform complex business requirements into automated, secure data solutions (ETL/ELT) primarily in Azure.
Optimize data storage and compute costs across Databricks clusters and Data Lake.
Troubleshoot and resolve production pipeline failures and data quality issues.
Drive best practices in data governance, security, and pipeline reliability.
Mentor and coordinate with global teams (data scientists, analysts, operations).
Required Skills & Experience
5–8 years (often 8+ in practice) in data engineering or platform roles.
Expert hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Deep SQL and data modelling skills (OLAP, OLTP, dimensional modelling).
Proficiency in Python/Scala for Spark jobs and data transformation.
Understanding of Azure Data Lake Storage optimizations and Azure resource cost tuning.
Experience implementing CI/CD and IaC for data pipelines.
Knowledge of data security/compliance (RBAC, encryption, GDPR principles).
More Info
Key Skills
GDPR Principles
IaC
CI CD
Azure Data Lake Storage
Data Security Compliance
About Company
Skills:
Spark SQL, Scipy, Pyspark, Azure Databricks, Numpy, Pandas, Azure Data Lake, Python, RDDs, Databricks Notebooks, MLflow, DataFrames, Synapse Analytics, Delta Lake, Blob Storage, Spark Pools
Skills:
Nosql, Azure, Sql, Sme