Data Engineer - Data Warehouse

It's fun to work in a company where people truly BELIEVE in what they're doing!

Job Description

The data warehouse engineering team plays an important role in the data team. We build, govern and maintain data warehouse platforms and environments as the foundation and source for every data product created by data analysts and scientists.

• Define data model convention and governance

• Design, develop and maintain data pipelines (external data source ingestion jobs, ETL/ELT jobs, etc)

• Design, develop and maintain data pipeline framework (combined open source and internal software to build and govern data pipelines)

• Create and manage data pipelines infrastructures

• Continuously seek ways to optimize existing data processing to be cost and time efficient

• Ensure good data governance and quality through build monitoring systems to monitor data quality in data warehouse.

Requirements

• Minimum 3 to 4 years working experiences in a similar/relevant area

• Fluent in Python and advanced-SQL

• Preferably familiar with data warehouse environments (eg: Google BigQuery, AWS Redshift, Snowflake)

• Preferably familiar with data transformation or processing framework (eg: dbt, Dataform, Spark, Hive, etc)

• Preferably familiar with data processing technology (Google Dataflow, Google Dataproc, etc)

• Preferably familiar with orchestration tool (eg: Airflow, Argo, Azkaban, etc)

• Understand data warehousing concept (eg: Kimball, Inmon, data vault, etc) and experience in data modeling and measure + improve data quality

• Preferably understand basic containerization and microservice concept (eg: Docker, Kubernetes)

• Having knowledge in machine learning, building robust API, and web development will be an advantage

• Able to build and maintain good relationship with stakeholders

• Able to translate business requirements to data warehouse modeling specifications

• Able to demonstrate creative problem solving skill

• A team player who loves to collaborate with others and can work independently when needed