About The Role
We are looking for a highly skilled Data Engineer Specialist to join our growing team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will work closely with data scientists, analysts, and business teams to ensure the efficient collection, storage, and processing of large volumes of data. This position plays a crucial role in enabling data-driven decision-making within the organization.
Key Responsibilities
- Design, develop, and manage data pipelines to ensure the efficient flow and processing of data from multiple sources.
- Build and optimize data architectures for both structured and unstructured data
- Collaborate with data scientists and business teams to gather requirements and implement data solutions.
- Ensure the integrity, accuracy, and security of data by performing regular data validation and quality checks
- Develop and maintain ETL (Extract, Transform, Load) processes to support data integration and warehousing.
- Optimize database performance by fine-tuning queries and ensuring efficient data storage solutions
- Stay current with the latest data engineering technologies and best practices to continuously improve processes.
Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role, with strong expertise in data pipeline development.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong knowledge of SQL and experience working with databases such as MySQL, PostgreSQL, or NoSQL databases.
- Experience with cloud-based data platforms such as AWS, Google Cloud, or Azure.
- Familiarity with big data technologies such as Hadoop, Spark, or Kafka is a plus.
Requirements
- Willingness to work onsite in Purbalingga.
- Strong analytical and problem-solving skills, with a keen attention to detail.
- Ability to work in a fast-paced environment and handle multiple projects simultaneously.
- Excellent communication skills with the ability to collaborate effectively with technical and non-technical stakeholders.
- Willingness to continuously learn and adapt to new tools and technologies.
- Willing to work onsite in Purbalingga as part of the team.
