About the job
GrabX is the core Configuration Management and Experimentation platform for Grab. We empower product teams to safely deploy features and make informed decisions through A/B testing and automated experiment analysis. Our platform efficiently manages Grab's substantial traffic, handling real-time configurations for millions of users while processing petabytes of data, yielding automated and statistically robust insights. Our aim is to significantly reduce the 'time to insight' for engineers and product managers, ensuring each launched feature at Grab is underpinned by high-fidelity data.
Role Overview
We are seeking a dedicated Lead Data Engineer to join our GrabX team. This pivotal role centers around the data backbone of experimentation, guiding the design of high-throughput data pipelines that support our automated analysis engines. You will report to an Engineering Manager based in Singapore and work on-site at our Grab Vietnam office located in District 7, Ho Chi Minh City.
Technical Stack
- Data Processing & Storage: Apache Flink, Apache Spark, Trino, StarRocks, and Delta Lake.
- Online Serving & Config: Golang, AWS infrastructure, Redis, ScyllaDB, and DynamoDB.
- Infrastructure: Kubernetes, Terraform, and CI/CD for data workloads.
Your Key Responsibilities
- Design and implement resilient batch and real-time data pipelines for processing billions of experiment events daily.
- Create efficient Spark or Flink jobs to compute complex business metrics and statistical significance at scale.
- Establish extensive data validation and monitoring frameworks to guarantee the accuracy and reliability of experiment outcomes.
- Lead the evolution of our data architecture towards a centralized Metric Store model for optimal reuse across product divisions.
- Mentor and guide a team of engineers, promoting best practices in data modeling and system design for data-intensive applications.
- Collaborate with Data Scientists to automate hypothesis testing and anomaly detection throughout the experimentation lifecycle.
