At Berani Digital ID, we strive to continually provide our customers with the high level of service and convenience they've come to expect in a changing world. A key part of this mission is ensuring we enhances data solutions enabling seamless delivery of data and is responsible for collecting, parsing, managing and analyzing large sets of data and to do that, we need a qualified and dedicated Data Engineer. The Data Engineer will be deeply involved in daily work across related stakeholders and subject matter experts.
Objectives
- Plan and organize the systematic obtaining of quality, useful and relevant information from the environment of the company and the competition.
- Detects changes in sales, income, expenses and other important data of the company or organization.
- Identify changes in consumer behavior or preferences in relation to the company for which they work and the competition.
- Transform data into reports and conclusions that serve to make the best decisions for the company in different areas such as financial, strategic, operational, etc.
- Detect new market opportunities and business lines based on the data extracted.
- Advise management in decision-making.
- Compare the strategies implemented and check if they have served to obtain the objectives or expected results.
- Identify errors, weaknesses and also strong points of the company.
Responsibilities
- Consulting with data management teams to get a big-picture idea of the company's data storage needs.
- Presenting the company with warehousing options based on their storage needs.
- Designing and coding the data warehousing system to desired company specifications.
- Conducting preliminary testing of the warehousing environment before data is extracted.
- Extracting company data and transferring it into the new warehousing environment.
- Testing the new storage system once all the data has been transferred.
- Troubleshooting any issues that may arise.
- Providing maintenance support.
Skills and qualifications
- Demonstrable experience as an Data Engineer within 2-3 years
- Understand ETL Concept, Automation Scheduling, & Data Pipelines
- Experience or understanding of other ETL tools, Knowledge of data modeling, database design, and the data warehousing ecosystem.
- Excellent analytical and problem-solving skills.
- Proficiency in SQL
- Skilled at ideation, design, and deployment of ETL solutions.
- The ability to work within a multidisciplinary team.
- Willing to work on-site in Jakarta
Preferred qualifications
- At least more 2 years working experience as Data Engineer with relevant experiences
- Familiarity with data engineering tools such as Spark, Hadoop, Talend, NoSQL, Pentaho, Informatica, AirFlow, Presto, Hive Kafka, IBM DataStage and/or Microsoft SSIS
- Familiarity with cloud big data environment such as AWS (EMR, Glue, Athena, Redshift), GCP (BigQuery, Dataflow, Dataproc) and Azure (Azure Synapse Analytics, Databricks, ADLS Gen 2)
- Proficiency in software engineering best practices such as clean/maintainable code, Git, code review, unit/integration testing, Infrastructure as Code, and Continuous Integration/Continuous Delivery.
