About the job
Our Mission
At Datacom, we collaborate with organizations and communities across Australia and New Zealand to create meaningful change in people's lives, empowering them to harness the potential of technology for innovation and growth.
About the Opportunity
Join our Datapay product team as a Principal Engineer – Data, a pivotal technical leadership role where you will be responsible for designing and developing the data platform that supports our next-generation payroll solution. You will define the technical vision for data ingestion, storage, transformation, and accessibility , encompassing real-time event pipelines, lakehouse storage, embedded analytics, and enterprise data access.
This is an exciting greenfield project; we are reconstructing our data platform from the ground up, transitioning from outdated batch architectures to a modern, composable stack built on open standards. Your contributions will be foundational in enabling AI-driven features, seamless integrations, and significant enhancements in reporting performance for our clients. You will influence architectural decisions, shape platform strategies, and enhance the data engineering capabilities within the team.
Key Responsibilities
As the Principal Engineer – Data, you will:
- Design and develop a contemporary, composable data platform utilizing open standards , selecting optimal patterns for data ingestion, storage, transformation, and querying to accommodate various analytical and operational workloads.
- Construct real-time streaming data pipelines that ensure rapid data freshness from source events to query-ready datasets.
- Establish the data infrastructure that enables AI capabilities , on-demand computing, isolated query environments, and semantic layers that render data accessible to both users and intelligent systems.
- Facilitate secure access for enterprise customers to their payroll data within their own BI tools, eliminating data duplication and minimizing operational overhead.
- Implement granular authorization across the data layer , ensuring multi-tenant isolation, role-based access, and sensitive data management compliant with strict payroll privacy regulations.
- Create layered data transformation models to support reporting and analytics , from raw event streams to curated, business-ready datasets.
- Define and enforce data contracts across domain teams, treating data as a product with designated ownership, quality benchmarks, and service level agreements (SLAs).
- Advocate for data sovereignty, immutability, and point-in-time query capabilities for audit and compliance purposes.
- Lead the technical collaboration with external data platform partners, ensuring effective knowledge transfer and enhancing internal capabilities.
- Mentor engineers, establish robust data engineering practices, and contribute to architectural decisions across the broader platform.
We prioritize agility and innovation in our work environment...
