Data Engineer
Job Description
- Design, build, and maintain scalable and efficient ETL/ELT data pipelines using a variety of tools and technologies.
- Manage and optimise our data warehouse, preferably with experience in Snowflake.
- Collaborate with business intelligence professionals to ensure data is structured for optimal performance in reporting and analytics, with a strong preference for experience with tools like Sigma Computing or similar BI platforms.
- Monitor data pipelines for performance and reliability, and troubleshoot issues as they arise.
- Implement data governance and security policies to ensure data integrity and compliance.
- Collaborate with cross-functional teams to identify data needs and develop solutions that meet business requirements.
- Stay up-to-date with industry trends and best practices in data engineering to continuously improve our data systems.
- Have 3+ years work experience (specialized in Data is preferred)
- Have at least 3 years hands on experience with SQL
- Proven to be skilled at ETL - SSIS / Talend / Kettle / Pentaho Debezium, Kafka, Flink, Spark Postgresql, Oracle Database, SQL, NoSQL, Gsql dan TG, Python, MongoDB
- Have knowledge of ETL, CDC, Event Based Streaming, GraphDB, REST API, Phyton, Basic Programming
- Eager & willing to learn new tech
- Available ASAP and WFO
- Have experience in insurance industry will be a plus point
More Info
Key Skills
About Company
Skills:
data masking , snowflake , Java, BigQuery, Oracle Database, Scala, SQL Server, Apache Airflow, Azure Data Factory, MySQL, Python, Google Cloud Workflows, Generative AI, Cloud Composer, IAM roles, API integrations
Skills:
S3, Github, RDS, Workflows, Pyspark, Data Modeling, Redshift, Sql, Pandas, Gitlab, Databricks, Python, AWS, Auto Loader, Aurora, Glue, Delta Lake
Skills:
containerization , T-sql, Data Security, Data Profiling, Data Architecture, Metadata Management, Data Integration, Data Cleansing, Data Modelling, Data Collection and Ingestion, Data quality management, Big data framework and tools, Hybrid hosting, API design and development, Dev-Sec-Ops
Skills:
Odi, Owb, Data pipeline, Data Warehouse, Etl, ELT, Enterprise ETL technologies, GCP Platform
Skills:
Etl Tools, Data Architecture, Python, Sql