Qualifications
Responsibilities Develop and maintain scalable data pipelines to process and integrate e-commerce data from various sources. Design and implement a modern cloud-based data lakehouse architecture leveraging AWS services like S3, Athena, Glue, Fargate, and Iceberg. Investigate and apply high-performance data transformation and analysis tools such as Polars, DuckDB, and PySpark. Collaborate with data analysts to provide structured and accessible datasets for reporting and advanced analytics. Work alongside architects in the design of data platforms. Identify opportunities to improve data quality and reliability. What You’ll Love About This RoleBuild from Scratch: Contribute to foundational data systems and processes that will shape the future of our platform. Learn by Doing: Gain hands-on experience with cutting-edge tools, cloud technologies, and real-world data challenges. Work on Complex Projects: Engage in exciting challenges, from integrating extensive e-commerce data to optimizing data pipelines for enhanced performance and scalability.
About the job
Join Cube Asia as a Data Engineer, where you will leverage diverse methodologies to convert raw data into impactful data systems. Your role will focus on enhancing efficiency by ensuring that our data systems align with business objectives.
Success in this role requires a solid background in large-scale public data collection from web sources, utilizing open APIs and various tools. A comprehensive understanding of the regulations and technical aspects surrounding such data collection is essential.
Familiarity with multiple programming languages and a foundational knowledge of machine learning techniques are also crucial. If you are detail-oriented, possess strong organizational skills, and have experience in this domain, we want to hear from you!
About Cube Asia
Cube Asia is at the forefront of data engineering, committed to delivering innovative solutions that harness the power of data. Our dynamic team thrives on collaboration, creativity, and continuous improvement, making us a leading player in the industry.