Search by job, company or skills

Data Engineer

2-4 Years
Early Applicant
  • Posted 19 days ago
  • Be among the first 10 applicants

Job Description

Job Description:

  • Design and develop data marts and data warehouses to support business intelligence and data analytics initiatives within the project lifecycle.
  • Handle end-to-end data pipelines from multiple internal and external sources, ensuring high performance, scalability, and establishing a Single Source of Truth for project deliverables.
  • Collaborate closely with Data PMs, Business Intelligence Analysts, and engineering team members to transform complex data into actionable business insights within designated project timelines.
  • Implement and maintain data management best practices across all project pipelines, focusing on data quality, security, and privacy.
  • Execute software development best practices, including test-driven development and code documentation, to ensure robust and maintainable data infrastructure.

Requirements:

  • Hold a Master's or Bachelor's degree in Computer Science, Information Systems, or other quantitative-based majors (Science or Engineering)
  • Possess 2 to 4 years of hands-on working experience in data engineering, data pipeline development, or data architecture.
  • Demonstrated expert-level proficiency in SQL, Spark, HDFS, and big data processing frameworks.
  • Expert knowledge of Object-Oriented and Functional Programming, with a strong preference for Python or Scala.
  • Solid experience working in UNIX environments, with deep understanding of batch processing, lambda architecture, and Kimball data modeling concepts.
  • Proficient in Software Development Life Cycle (SDLC) practices, including version control, test-driven development, and technical documentation.

More Info

Job Type:
Employment Type:

About Company

Shopee Pte. Ltd. is a Singaporean multinational technology company that specialises in e-commerce. The company was launched in Singapore in 2015, before it expanded abroad. As of 2021, Shopee is considered the largest e-commerce platform in Southeast Asia with 343 million monthly visitors.

Job ID: 151794565

Similar Jobs

Bandung, Indonesia

Skills:

Node.jsData ModelingCubeSoftware EngineeringPythonknowledge engineeringBI analytics engineeringdata platformSemantic or metrics-layer experiencedbtanalytical modelingOLAP warehouse systemsMetricFlowStrong SQLOpen-source semantic layer enginesAPI service mindsetLookML

Indonesia

Skills:

containerization T-sqlData SecurityData ProfilingData ModelingData ArchitectureMetadata ManagementCodingData IntegrationData CleansingData collection and ingestionData quality managementBig data frameworks and toolsHybrid hostingAPI design and developmentDev-Sec-Ops

Remote, Bengaluru, India

Skills:

Data ModelingDashboardingSqlELTData QualityData VisualizationPythonEtlSaaS Enterprise business modelsData processing performance tuningLogging specificationsProduct analyticsAnomaly detection solutions

Indonesia

Skills:

Data WarehouseMetadata ManagementKafkaData ModelingSqlELTData QualityDockerCloud InfrastructureData GovernanceData LakeKubernetesPythonEtlAirflowPub Subpipeline orchestration

Indonesia

Skills:

snowflake NosqlS3PysparkAWS GlueSqlAWS

Beware of Scammers

We don’t charge money for job offers