Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

AME Research
3-5 Years
  • Posted 15 days ago
  • Be among the first 10 applicants

Job Description

Home

> Careers

> Data Engineer

Data Engineer

09 Dec 2025

Location: Jakarta

Position Type: Full-time (in office)

Reports to: CTO

About The Role

We're looking for a Data Engineer to design, implement, and maintain reliable data pipelines that collect and process data from various public APIs into a centralised blob storage and database environment. You'll play a key role in ensuring data is ingested efficiently, transformed cleanly, and made accessible for downstream analysis and reporting.

This role involves working with Python-based ETL pipelines, workflow orchestration (Apache Airflow or equivalent), and cloud storage solutions (e.g., Azure Blob Storage).

Key Responsibilities

  • Design and implement robust ETL/ELT pipelines to extract data from multiple public APIs and load into blob storage and relational databases.
  • Build and manage scheduled workflows using tools such as Apache Airflow (or similar).
  • Handle complex API integrations, authentication flows (OAuth2, API keys), pagination, and rate limiting.
  • Structure data in blob storage (e.g., Azure Blob) for efficient downstream access.
  • Transform and load data into structured SQL-based databases for analytics and access by Web applications
  • Implement monitoring, logging, and validation to ensure data integrity and pipeline reliability.
  • Work closely with data scientists, and software developers to ensure data availability and usability.
  • Maintain clear documentation for data sources, transformations, and orchestration logic.

Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, or a related field (or equivalent experience).
  • 3+ years of experience building data pipelines in a production environment.
  • Strong understanding of ETL/ELT architecture, API data ingestion, and data modelling principles.
  • Experience with Azure

Technical Skills

  • Languages: Python (preferred), SQL (Microsoft T-SQL)
  • Orchestration: Apache Airflow or similar
  • RESTful API integration (authentication, pagination, error handling)
  • Azure Blob Storage
  • Familiarity with version control (Git) and CI/CD pipelines

Nice To Have

  • Experience integrating data from open economic and financial APIs (e.g., World Bank, IMF, OECD, UN Data, FRED)
  • Familiarity with large structured and semi-structured datasets (JSON, CSV, Parquet) and associated performance considerations
  • Experience building incremental ingestion or change data capture (CDC) pipelines

Soft Skills

  • Strong analytical and problem-solving mindset
  • Clear communication of technical concepts to non-technical stakeholders
  • Attention to detail and data accuracy
  • Proactive approach to monitoring

What We Offer

  • Modern, central office near to public transport and key amenities
  • Competitive salary

How To Apply

If you're interested in this role, please send your CV and Cover Letter to [Confidential Information].

More Info

Job Type:
Industry:
Employment Type:

Key Skills

RESTful API integration

Rate limiting

CI/CD pipelines

Microsoft T-SQL

Azure Blob Storage

API keys

About Company

Similar Jobs

2-4 yrs
Indonesia
Skills:
PostgreSQL, Data Warehousing, Json, Informatica, ELT, MySQL, Oracle, Talend, Python, AWS, Apis, Google Cloud Platform, Csv, SQL Server, Dimensional Modeling, SSIS, Sql, Git, DataStage, Xml, Azure, Etl, Airflow, Snowflake Schema, data lake architecture, Pentaho
2-4 yrs
Indonesia
Skills:
Spark SQL, Pyspark, Apache Spark, Sql, Python, dbt, Dataform
2-4 yrs
Indonesia
Skills:
Big Data, Sql, lingkungan komputasi berbasis cloud, Big Data Management Framework, tools integrasi data
3-6 yrs
Remote
Skills:
data engineering , Big Data, Python Backend, Sql, Apache Hadoop, MLops
3-7 yrs
IDR 11,000,000 - 16,000,000 per month
jakarta Raya, Tangerang, Metro
Skills:
Sql, Python, Etl, Data Warehousing, Spark, Kafka, AWS, Gcp, Data Modeling, Nosql