About the job
Sword Group is a premier provider of innovative business technology solutions catering to the Energy, Public, and Finance sectors. We are dedicated to driving transformational change for our clients through the application of proven technologies, specialized teams, and deep domain expertise. Our commitment lies in harnessing technology to address complex business challenges, working collaboratively with our clients to help them achieve their objectives.
About the Role:
The Data Engineer position presents a remarkable opportunity for individuals seeking to enhance their technical prowess within the contemporary Microsoft data ecosystem while assuming greater ownership and accountability within project teams. This role is pivotal to client delivery, entailing the design and construction of robust data pipelines, the integration of intricate data sources, and the development of solutions utilizing Azure Data Services, Microsoft Fabric, Power BI, and Purview.
As an Intermediate Data Engineer, you will tackle advanced engineering challenges, enhance existing pipelines, and contribute to the architecture of scalable, high-quality data frameworks. You will work closely with clients and cross-functional teams, translating business requirements into effective data solutions, while also initiating support and mentorship for junior engineers. This role is perfect for those aiming to advance towards senior-level responsibilities, gain insights into architectural considerations, and engage with state-of-the-art technologies, including Microsoft Foundry as part of emerging AI-driven capabilities. Candidates are encouraged to apply if they seek a position that combines hands-on engineering, problem-solving, continuous learning, and significant contributions to client success within a dynamic Data & AI business unit.
Key Responsibilities:
- Design, implement, and maintain scalable, secure, and high-performing data pipelines using Azure Data Factory, Synapse, Fabric Pipelines, or Databricks.
- Integrate data from various systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and optimal performance.
- Develop and manage ELT/ETL processes utilizing Azure-native tools and Fabric capabilities, optimizing for cost-efficiency and performance.
- Construct and maintain Microsoft Fabric artifacts, including lakehouses, warehouses, notebooks, dataflows, and semantic models.
- Execute advanced data transformations using SQL, Python, Spark, or Fabric Data Engineering experiences to prepare data for analytical and reporting purposes.
- Oversee and refine data models utilized by Power BI, ensuring optimal performance, relationships, quality, and reusability.
- Facilitate enterprise BI development by preparing datasets, semantic models, and reusable components within Power BI and Fabric.
- Implement data governance and security best practices by utilizing Purview.
