Search by job, company or skills

bumi amartha teknologi mandiri

Data Engineer

2-4 Years
Save
  • Posted 17 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

  • Design, develop, and maintain scalable data pipelines using Python and PySpark/Apache Spark.
  • Build, optimize, and manage ETL/ELT workflows to support data integration and transformation processes.
  • Write efficient SQL queries and implement data transformation logic to prepare data for analytics and business reporting.
  • Develop and manage cloud-based data solutions on Google Cloud Platform (GCP) and/or Amazon Web Services (AWS).
  • Design and maintain reliable, scalable, and high-performance data processing workflows.
  • Implement and maintain data lakehouse architectures to support modern analytics and data engineering use cases.
  • Collaborate with data analysts, data scientists, and software engineers to deliver high-quality data solutions.
  • Ensure data quality, integrity, and consistency across data pipelines and storage systems.
  • Use Git or other version control systems to manage source code, collaborate with team members, and support CI/CD workflows.
  • Monitor, troubleshoot, and optimize data pipelines to ensure reliability, performance, and scalability.
  • Follow data engineering best practices for coding, testing, documentation, and deployment.
  • Stay updated with emerging cloud data technologies and contribute to continuous improvement initiatives.

Minimum Qualifications

  • Minimun 2 years experiences in related field
  • Proficiency in Python programming.
  • Hands-on experience with PySpark / Apache Spark.
  • Strong SQL skills and understanding of data transformation techniques.
  • Experience working with Google Cloud Platform (GCP) and/or Amazon Web Services (AWS).
  • Good understanding of ETL/ELT concepts and data pipeline development.
  • Experience with Git or other version control systems.
  • Familiarity with data lakehouse architecture and modern data platforms.
  • Strong analytical and problem-solving skills.
  • Good communication and collaboration abilities.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 150597233

Similar Jobs

Indonesia

Skills:

JavaTerraformScalaApache SparkKafkaPythonAWSMetabaseData-bricksDagster

Semarang

Skills:

DatabricksSqlData ModelData WarehousingApache SparkRDBMSCloud ArchitectData LakePower BiApiNosqlPythonAzureSparkBig data toolswireframe designDAX programmingData Solution ArchitectStory Telling

Indonesia

Skills:

Data TransformationKafkaData pipelineGrafanaSqlData ProcessingObservabilityMonitoring

Indonesia, Surabaya

Skills:

JavaGolangNode.jsdata pipelineData ModelingApi IntegrationSqlELTDatabase OptimizationGitPhpPythonEtlscalable system architecture

Indonesia

Skills:

GolangBigQueryGcpPythonPub SubAirflowCloud FunctionsCloud RunClickHouse