About the job
Join our dynamic team at UBDS Group as an AWS Data Platform Engineer, where you’ll leverage your expertise to design, implement, and enhance AWS cloud infrastructure and CI/CD pipelines. This pivotal role emphasizes AWS-native data services, infrastructure automation, and orchestration to facilitate large-scale data operations.
Key Responsibilities:
- Provision, manage, and optimize AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, and Batch.
- Implement Infrastructure as Code (IaC) using Terraform.
- Manage orchestration workflows through Apache Airflow.
- Support and maintain CI/CD pipelines and version control with GitLab.
- Monitor core services including security file scanning for S3, data infrastructure access, and usage patterns.
- Oversee infrastructure supporting Data Engineering workflows, focusing on disaster recovery and performance enhancements.
- Collaborate with Data Engineering, SRE, and Security teams to ensure secure and efficient data operations.
- Diagnose and resolve incidents related to AWS data infrastructure.
- Participate in documentation and process improvements.
- Manage access and Role-Based Access Control (RBAC).
Requirements:
- Demonstrated hands-on experience with AWS native data services such as S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Step Function, SQS, CloudWatch, CloudTrail, and EMR.
- Proficient in using Terraform for Infrastructure as Code.
- Experience with Airflow for DAG orchestration and monitoring.
- Familiarity with YAML for CI/CD pipelines (e.g., GitLab CI/CD, GitHub Actions).
- Proficient in Python, SQL, and Bash for automation, querying, and troubleshooting.
- Strong understanding of AWS Security best practices, IAM policies, and RBAC.
- Knowledge of AWS Networking and VPC.
- Experience with containerization technologies such as Docker.
- Experience with Disaster Recovery, backups, and snapshots.
Desirable Skills:
- Familiarity with AWS Neptune and EKS.
- Experience with Jira Service Desk.
- Experience in supporting Data Engineers.
- Consulting experience is a plus.
- Ability to produce README and Confluence documentation.
Soft Skills:
- Exceptional problem-solving and troubleshooting abilities.
- Able to thrive in an Agile environment.
- Skilled in stakeholder management.
- Excellent communication and collaboration skills.
Benefits:
At UBDS Group, we pride ourselves on being a forward-thinking organization that nurtures talent and encourages growth. Join us to be part of innovative projects that shape the future of data.

