Data Engineer - Traffic Mart
Job Description
Job Description:
- Build and operate the Marketplace data warehouse end to end, covering batch and real-time ingestion, semantic layer design, and application-layer modeling for downstream consumers.
- Collaborate with product, business, and engineering teams to translate requirements into scalable data architectures that support BI reporting, self-serve analytics, and algorithmic applications.
- Design and optimize large-scale data processing pipelines, improving throughput, latency, and cost efficiency across offline and streaming platforms.
- Lead data quality and governance efforts, including schema standardization, lineage tracking, SLA monitoring, and best practices that increase reliability and user trust.
- Evaluate and adopt emerging data technologies such as streaming engines, lakehouse architectures, and AI/ML data stacks to address key Marketplace challenges and evolve the platform roadmap.
Requirements:
- Bachelor's Degree or above in Computer Science or related fields
- At least 3 years of data engineering experience
- Prior experience or knowledge working with Traffic Mart would be advantageous
- Experience with big data processing technologies such as Spark, Flink, Hadoop or HBase
- Proficiency in one or more programming languages, such as Java, Scala, Python, SQL, etc.
- Familiar with data warehouse architecture and principles
More Info
Job Type:
Industry:
Function:
Employment Type:
About Company