Search Jobs

Search by job, company or skills

Principal Data Engineer

Principal Data Engineer

OSI Digital
Early Applicant
  • Posted 8 days ago
  • Be among the first 10 applicants

Job Description

Role Overview

We are seeking a highly skilled, hands-on Lead Data Engineer with 7 to 8 years of experience to join our data engineering team in Hyderabad. In this role, you will act as a hardcore technical expert and a team leader, capable of architecting, building, and maintaining robust data pipelines while independently driving projects from conception to deployment. The ideal candidate possesses a unique blend of legacy and modern data stack expertise—specifically bridging Oracle ERP/OBIA systems with modern cloud data platforms like Snowflake and Databricks.

Location: Hyderabad

Experience: 7 – 8 Years

Role Type: Full-time, Technical Development & Leadership

Key Responsibilities

Technical Leadership & Delivery

  • Act as the technical anchor for the data engineering team, providing architectural guidance, code reviews, and mentoring junior engineers.
  • Independently gather requirements, design, develop, and deploy scalable data pipelines and ETL/ELT workflows.
  • Drive the migration and integration of legacy Oracle data environments into modern cloud data platforms (Snowflake/Databricks).

Data Pipeline & Platform Engineering

  • Architect and implement high-performance data warehouses and lakehouses using Snowflake and Databricks.
  • Write highly optimized, scalable code using Python and PySpark for complex data transformations and streaming/batch processing.
  • Design and manage data integration workflows using Oracle Data Integrator (ODI) and modern pipeline tools.

Oracle Techno-Functional Domain Expertise

  • Utilize deep techno-functional knowledge of Oracle ERP / Oracle Apps modules (e.g., Financials, SCM, HRMS) to understand source data structures.
  • Leverage experience with OBIA (Oracle Business Intelligence Applications) to extract, model, and deliver business-critical analytics.
  • Write complex, high-performance SQL queries, stored procedures, and performance-tuning scripts.

Technical Skills

  • Languages: Expert-level proficiency in SQL and Python.
  • Strong hands-on experience with PySpark, Databricks, and Snowflake (including Snowpipe, tasks, and streams).
  • Proven track record with ODI, OBIA, and a strong techno-functional understanding of Oracle ERP/Apps schemas and business logic.
  • Strong understanding of Data Warehousing concepts, Star/Snowflake schemas, and Delta Lake architecture.

Leadership & Soft Skills

  • Demonstrated ability to lead projects independently with minimal supervision.
  • Experience managing/leading a small to mid-sized team of data engineers.
  • Excellent communication skills to articulate technical designs to both technical teams and business stakeholders.
  • Strong problem-solving mindset with a hardcore technical approach to debugging and performance optimization.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

8-10 yrs
Hyderabad, India
Skills:
OrchestrationKafkaSqlSpark StreamingGcpTerraformSparkPythonAWSlakehouseAirflowData CataloglineageWarehouseFlinkserving layerdata quality governanceTransformationdbtDagsterfeature storeobservability
10-12 yrs
Hyderabad, India
Skills:
Power BiAzure SqlSqlAzure SynapseAzure Data LakePythonLogic AppsEvent HubService BusMicrosoft FabricAzure Durable FunctionsEvent GridAzure Monitor
10-12 yrs
Hyderabad, India
Skills:
snowflake Bi ToolsGithubPostgreSQLCursorSqlReactRuby On RailsTerraformEtlAWSanalytics platformsAirbyteClaudeAI coding assistantsELT pipelinesdbtFivetranCode Copilot
10-12 yrs
Hyderabad, India
Skills:
qa engineering composer DevSecOpsBddKafkaBigQueryRedisMySQLAtddPythonKubernetesGcpTddSparkAirflowSREXp
7-9 yrs
Bengaluru, Hyderabad, India
Skills:
SeabornSqlApache FlinkApache AirflowApache SparkPandasOracle DatabasePrestoNumpyTableauKafkaPower BiPythonOracle Data IntegratorScipyMatplotlibOracle Autonomous Data WarehouseOracle Analytics Cloud