Lead Data Engineer

Role Overview PetroApp is seeking a Lead Data Engineer in Cairo to shape and advance the company’s data capabilities. This senior role influences PetroApp’s data strategy, working across analytics, business intelligence, engineering, governance, and advanced analytics. The Lead Data Engineer partners closely with Product, Engineering, Operations, Commercial,…

Role OverviewWe are seeking a highly skilled Data Engineer Team Lead to spearhead the design and validation of robust data pipelines, data structures, and cutting-edge big data solutions, including data lake platforms. This role is crucial for optimizing data search and retrieval processes within our organization. You will collaborate closely with data structure designers to establish a comprehensive enterprise data architecture.Key ResponsibilitiesEnhancing Data Quality and Reliability:* Develop and implement innovative strategies to enhance data reliability and quality.* Integrate raw data from diverse sources to produce consistent, machine-readable formats.Data Structure Development:* Lead the design and testing of data structures that facilitate effective data extraction and transformation for predictive and prescriptive analytics.Process Definition:* Establish and manage development, testing, release, and support processes for data engineering operations. Identify and rectify code bugs as necessary.Big Data Model Development:* Oversee the creation of big data models and use cases that are aligned with data structures, preparing them for seamless data operations.Query Execution:* Formulate and execute queries on both structured and unstructured data sources to diagnose process issues or conduct bulk updates.Feature Layer Implementation:* Direct the development and implementation of feature zones with essential features and KPIs requested by stakeholders to support robust machine learning models.Batch Scheduling and Reporting:* Ensure accuracy and timeliness in batch production scheduling and report distribution.Data Transformation Management:* Design and oversee processes that support data transformation, data structures, metadata management, dependency tracking, and workload management.Required Competencies* Performance Excellence* Leadership & Empowerment* Collaboration & Synergy Creation* Agility & Resilience* Innovation & Digital Transformation* Strategic Thinking* People-Centric ApproachTechnical Skills* Strong proficiency in Java, C#, and Python for application development.* Extensive experience with Cloudera or comparable big data platforms, including services like Apache Hive, Apache Scala, BizSpark, Impala, Apache Spark, Data Security, Kafka, HBase, Sqoop, NiFi, and Python for programming and data analysis.* Expertise in handling and processing large datasets using distributed computing frameworks.* Advanced SQL skills for querying and managing relational databases.* Comprehensive understanding of data warehousing principles and best practices.* Proficiency in data analysis and visualization tools.

Become a part of EVA Pharma, a pioneering pharmaceutical organization committed to championing health and well-being as an essential human right. Celebrated for our exceptional workplace culture, we strive to cultivate an environment that encourages support and innovation among our team members.Job Overview: We are in search of a driven and skilled Senior Lead Data Engineer to integrate into our vibrant team. The successful candidate will play a crucial role in our mission to advance human health and well-being, ensuring we uphold the highest standards of excellence within our sector. Primary Responsibilities:Architect, develop, and sustain robust ETL/ELT pipelines that transfer data from various sources into cloud-based data warehouses such as Snowflake, BigQuery, or Databricks. Guarantee real-time or near-real-time data processing for analytical dashboards and operational systems while continuously optimizing performance to adeptly manage increasing data volumes.Establish automated validation protocols, anomaly detection mechanisms, and alerting systems to uphold superior data accuracy. Ensure all pipelines adhere to data privacy and security regulations (e.g., GDPR, SOC 2). Maintain comprehensive documentation and data lineage to facilitate audits and cross-team transparency.Assess and implement new tools like Airflow, dbt, Kafka, or Spark to enhance operational efficiency and scalability. Collaborate with AI/ML teams to support the deployment and integration of sophisticated models.Create best practices for data modeling, storage efficiency, and version control. Align data structures with critical business metrics and analytical applications to ensure consistency across various departments.Conduct design evaluations, uphold high-quality coding standards, and promote a collaborative environment centered on innovation and ongoing enhancement. Additionally, mentor and guide fellow data engineers to refine their technical expertise and boost project outcomes.

Join our dynamic team at Integrant as a Lead Storage Engineer, where your expertise will be crucial in managing diverse data storage infrastructures. We are looking for a passionate and seasoned professional with in-depth knowledge of Weka, Ceph, and other parallel and object storage solutions. In this role, you will oversee various storage administration responsibilities, such as provisioning, configuring, monitoring, and troubleshooting, all while interacting with our clients.Key Responsibilities:Manage and maintain Weka and Ceph storage environments.Provision storage resources to fulfill application and user needs.Configure and manage storage pools, volumes, and snapshots.Implement and uphold data protection strategies, including backups and replication.Monitor storage performance and capacity utilization.Identify and resolve storage-related issues efficiently.Carry out routine maintenance tasks as required.Stay informed about the latest storage technologies and best practices.Document storage configurations and procedures clearly.Participate in an on-call rotation to provide critical support for AI and High-Performance Computing (HPC) operations.

Join Our Team!Integrant is on the lookout for innovative thinkers to step into the role of Lead Data Scientist. As a pivotal member of our team, you will be entrusted with the following responsibilities:Utilize your expertise in mathematics, statistics, and computer science to derive actionable insights from a variety of data forms—structured, semi-structured, and unstructured—empowering our clients to make informed, data-driven decisions.Engage in exploratory research to create novel algorithms tailored to meet specific client requirements, particularly for challenges that existing methods cannot address.Collaborate closely with clients to understand their data science needs through thorough requirement gathering.Provide mentorship and guidance to junior data science team members, fostering their professional growth.Deliver robust machine learning models to clients while facilitating knowledge transfer.

Join our dynamic team as a Senior Data Engineer, where you will harness the power of data to drive impactful solutions. You will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our mission of fostering inclusivity in technology.Your expertise will help us analyze and interpret complex data sets, ensuring data integrity and optimizing data flows. If you are passionate about utilizing data to enhance decision-making and drive business outcomes, we want to hear from you!

Enhancing Data Quality and Reliability:• Develop and implement advanced methodologies to boost the reliability and quality of data.• Integrate raw data from diverse sources to form consistent and machine-readable formats.Structural Development:• Design, develop, and test data structures that facilitate data extraction and transformation for predictive and prescriptive modeling.Process Definition:• Establish and oversee development, testing, release, update, and support processes for data engineering operations. Analyze and resolve code issues effectively.Big Data Models:• Create and optimize big data models and use cases based on the established data structure, preparing them for end-user data operations.Query Execution:• Formulate and execute queries on both structured and unstructured data sources to diagnose process issues and perform bulk updates.Feature Layer Development:• Design and implement the feature zone with essential features and KPIs required by various stakeholders, aiding in the construction of robust machine learning models.Batch Scheduling and Reporting:• Ensure accurate and timely batch production scheduling and report distribution.Ad Hoc Requests:• Address ad hoc requests from users, such as data research, file manipulation and transfer, as well as investigating process issues.

Join our dynamic team as an Azure Data Engineer, where you'll leverage your expertise to evaluate and transform complex data sources, both SAP and non-SAP, into actionable business insights. Your role will involve developing and integrating these data sources into our cutting-edge Azure Data platform, ensuring that our analytics capabilities stay ahead of the curve. Key Responsibilities:• Conduct in-depth analyses of structured, semi-structured, and unstructured data sources to assess quality, completeness, and business impact.• Create, document, develop, implement, and test rapid prototypes demonstrating the value of data, showcasing your work to varied audiences.• Engage in early-stage design and feature definition processes.• Develop robust data pipelines using the Microsoft toolset and Databricks Stack, ensuring they are reusable and scalable.• Collaborate effectively with multidisciplinary engineering teams to integrate proven prototypes into production.

Join our dynamic team at SanaCommerce as a Senior Data Engineer. In this critical role, you will leverage your expertise in data engineering to build robust data pipelines and enhance our data processing capabilities. Collaborate with cross-functional teams to design and implement innovative solutions that drive data-driven decision-making across the organization.

About Us:At Xenon7, we unite exceptional tech talent with world-class opportunities! Collaborating with top-tier enterprises and innovative startups, we engage in exciting, cutting-edge projects that utilize the latest technologies across various IT domains, including Data, Web, Infrastructure, AI, and more. Our expertise in developing IT solutions and providing on-demand resources enables us to partner with clients on transformative initiatives that drive innovation and business growth. Whether empowering global organizations or collaborating with pioneering startups, we are dedicated to delivering advanced, impactful solutions that address today's most intricate challenges.About the Client:Become part of one of Egypt's leading financial institutions, celebrated for its comprehensive range of banking services, including Institutional Banking, Personal Banking, and Islamic Banking. With a global footprint through over 50 branches and correspondents, our diverse and dynamic clientele is at the forefront of our operations. As we embark on a revolutionary digital transformation journey, we are committed to leveraging cutting-edge technologies to build a state-of-the-art data architecture that will redefine our performance and service delivery.Position Overview:We are looking for a driven and experienced Senior Data Engineer to join our expanding data team. In this pivotal role, you will design and develop scalable, high-performance data pipelines and lakehouse architectures. Collaborating closely with data modelers, analysts, and business stakeholders, you will deliver reliable real-time and batch-based data solutions that are integral to our analytics and AI-driven strategies.

About UsWelcome to Foodics! We are a premier restaurant management ecosystem and payment technology provider, established in 2014. With our headquarters in Riyadh and operations spanning five countries—including the UAE, Egypt, Jordan, and Kuwait—we proudly serve customers and partners across over 35 nations. Our cutting-edge products have facilitated the processing of more than 6 billion orders, establishing Foodics as one of the fastest-growing SaaS firms in the MENA region. Recently, we achieved a significant milestone with our third funding round, raising $170 million, which marks the largest SaaS funding in MENA to date, further enhancing our innovation capabilities to better serve business owners.Role OverviewAs a Senior Data Engineer, you will play a pivotal role in designing and constructing robust data pipelines, data contracts, and processing frameworks that drive analytics and machine learning capabilities at Foodics. You will collaborate closely with ML Engineers and platform teams to ensure our data infrastructure is reliable, scalable, and governed effectively.Your ResponsibilitiesArchitect and implement scalable ETL/ELT pipelines utilizing cloud-native solutions.Establish and uphold data contracts with domain squads and internal stakeholders.Partner with ML Engineers to facilitate feature engineering and prepare model-ready datasets.Develop monitoring, alerting, and observability mechanisms for the data infrastructure.Ensure compliance with data security, lineage, and internal governance standards.Contribute to onboarding toolkits and reusable data components.Qualifications We Seek5+ years of experience in data engineering with proven expertise in building scalable pipelines.Proficient in Python, SQL, and orchestration tools such as Airflow, AWS Glue, or Step Functions.Experience with modern Lakehouse architectures and tools (e.g., S3, Redshift, Snowflake, dbt).Strong understanding of data modeling, lineage, observability, and governance frameworks (e.g., dimensional modeling, normalized vs. denormalized structures).Familiarity with ACID-compliant data formats like Apache Iceberg, Delta Lake, or Apache Hudi, and experience managing large-scale datasets with features such as time travel and schema evolution.Expertise in building fault-tolerant, testable, and maintainable pipelines in production settings.Demonstrated ability to collaborate effectively within cross-functional teams, including ML Engineers, Analysts, and Product Managers.Familiarity with CI/CD and infrastructure-as-code tools (Terraform/CDK preferred).Excellent communication skills with a focus on documentation, standards, and continuous improvement.Ideal Candidate TraitsKnowledge of MLOps integration and streaming technologies is a plus.

Data Pipeline Development & InfrastructureArchitect, develop, and sustain robust and scalable data pipelines that support both structured and unstructured data.Create and implement real-time and batch data processing frameworks.Develop ETL/ELT workflows for data ingestion from diverse sources, ensuring optimal performance and reliability.Enhance data storage and retrieval mechanisms for real-time and batch operations.Design a cost-effective and efficient data infrastructure that adapts to the evolving needs of the business.Data Solutions & AI-Driven ApplicationsConstruct data pipelines to support machine learning recommenders, search functionalities, and AI-enhanced features.Develop and maintain data models, APIs, and integrations that facilitate analytics and customer applications.Support eCommerce data solutions such as product recommendations, customer segmentation, and personalization strategies.Collaboration & Continuous ImprovementCollaborate with Data Architects, Analysts, and Product Teams to identify data requirements and deliver top-tier solutions.Monitor and resolve performance issues to maintain high availability and efficiency of data pipelines.Continuously enhance the cost, performance, and scalability of data engineering solutions.

Key ResponsibilitiesArchitect and implement scalable and dependable data pipeline solutions.Prioritize and manage daily tasks in alignment with sprint planning outcomes.Collaborate with various commercial teams to deliver tailored customer offerings.Guarantee timely delivery of high-quality outputs.Plan releases and provide comprehensive support for deployed packages.

Envision Employment Solutions is on the lookout for a skilled Data Operations and Support Engineer to join our esteemed partner, a renowned global leader in IT Services and Consulting.Job SummaryThe Data Operations and Support Engineer will play a crucial role in ensuring the seamless operation and support of enterprise data platforms and integrations. This includes monitoring, troubleshooting, and maintaining production workflows across various systems such as SAP PO, Informatica, and Cloudera, while upholding data integrity and ensuring timely issue resolution.Key ResponsibilitiesOversee the end-to-end implementation of data strategies to support enterprise data management functions.Utilize supporting tools and logs to identify and present root causes of data issues across different functions.Manage the processes of production data operations, deployments, documentation, and data population to ensure compliance with corporate data management standards.Collaborate closely with data functions to ensure all support processes adhere to bank policies, internal controls, data protection legislation, and relevant industry standards.Identify opportunities for process efficiency and improvement, proposing and implementing data automation initiatives.Foster strong collaborative relationships with internal stakeholders, subject matter experts, clients, and vendors.Implement and oversee data backup, restore, and archiving solutions.Ensure data availability throughout its lifecycle.Monitor and manage the performance of data solutions, layers, and transactions.Align database standards from DBA to data support requirements across management layers.Support new data products and participate in new project initiatives.

At Unifonic, a proud recipient of the Great Place to Work® award, we are an innovative startup in the SaaS domain, transforming business communication. Our dedicated team of over 500 enthusiastic Unifones is committed to providing exceptional experiences for more than 5000 customer-focused businesses.We foster a fun and collaborative culture where creativity thrives and new ideas are welcomed. As stakeholders in our company, we are more than just communicators; we are Unifones. Join us and contribute to something remarkable!Join Our Engineering Team!Our Engineering team is pivotal in designing, developing, and maintaining the technologies that power Unifonic’s solutions. We collaborate closely with various departments to ensure our offerings align with customer needs. If you have a passion for technology and are eager to work on innovative communication and engagement solutions, we want to hear from you.As the Software Engineering Lead, you will actively engage in the software development process while managing your own team. This role involves regularly contributing to production code.Help Us Shape the Future of Communication by:Assisting with the recruitment and onboarding of engineering talent.Collaborating with other engineering teams to identify changing requirements and enhance the development environment.Working with product managers, designers, and engineers to prioritize and plan tasks.Communicating project status, risks, and requirements across teams.Providing both technical and non-technical guidance to the team individually and collectively.

Job DescriptionAs the Lead IT Quality Engineer, you will play a pivotal role in elevating the quality standards across our IT product lifecycle. This position is crucial for the success of product teams, necessitating a distinctive combination of leadership capabilities, in-depth knowledge of the IT product lifecycle, and a proactive approach to anticipating and addressing potential quality challenges.In your capacity as a QE Lead, your core responsibility will be to monitor, guide, and mentor product teams. By delivering continuous feedback and coaching, you will foster a culture centered around quality and excellence. Exceptional communication and collaboration skills are vital to your success.You will frequently need to make significant decisions regarding quality enhancements and corrective measures, requiring a high degree of confidence and assertiveness.By maintaining stringent quality standards, you will enhance the company's reputation as an industry leader, securing a competitive edge in the market.Key Responsibilities: Guide and mentor teams to adhere to quality guidelines established in the IT Global Quality Strategy. Ensure each team understands and is familiar with the Quality Gates to be achieved. Oversee the compliance with Quality Gates at all stages of the IT Products Lifecycle. Collaboratively define corrective actions for unmet Quality Gates and track their effectiveness. Collect metrics and generate reports on quality for each team. Provide insights to the QA Manager to assist in shaping the Quality Strategy. Serve as the primary contact for all quality-related matters within Platforms, ARTs, and Product teams. Act as a liaison between external teams and CCH to ensure adherence to internal quality standards and promote team collaboration. Work closely with Scrum Masters and RTEs to ensure adherence to established Agile methodologies. Maintain an overview of quality across all product teams at both Platform and ART levels. Support the onboarding process for new team members. You will oversee quality throughout each phase of the Product Development Lifecycle without engaging in hands-on testing.

b_labs serves as the transformative and digital innovation arm of B.TECH, dedicated to revolutionizing the industry landscape. As a key player in technological advancement within B.TECH, a pivotal entity in the Egyptian retail sector, we are committed to propelling B.TECH toward its vision of becoming the foremost omni-channel platform for consumer electronics and appliances in Egypt. By joining b_labs, you will thrive in a collaborative startup atmosphere while benefiting from the stability of a company that consistently achieves remarkable growth. You will become a vital member of a forward-thinking, customer-centric team with a bold mission to lead the digital retail transformation across the Middle East.Key Responsibilities:Design, implement, and manage large-scale, reliable data pipelines utilizing Python, SQL, and big data technologies such as Apache Spark and Kafka.Build and refine ETL/ELT processes for data transformation, loading, and integration from diverse sources.Develop and maintain robust data storage solutions leveraging both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB.Establish and oversee CI/CD pipelines for data workflows, facilitating automated deployments and version control.Utilize AWS services to create, deploy, and monitor scalable cloud-based data solutions.Employ Apache Airflow for workflow orchestration and use PostHog for analytics tracking and event data management.Enhance data warehousing solutions to meet business intelligence and analytics requirements.Ensure data integrity, consistency, and security across multiple systems and sources.Troubleshoot and optimize data systems for enhanced performance, scalability, and cost efficiency.Foster and contribute to a collaborative, innovative, and agile team culture.

Job Description:As a Lead Technical Engineer, you will play a pivotal role in shaping the solution architecture and design to meet product requirements and exceed customer expectations. Your responsibilities will include implementing, reviewing design implementations, and collaborating with the team on documentation.You will ensure that both functional and non-functional technical specifications are met, maximizing performance and security of the developed software from the early stages of the project lifecycle.In this role, you will establish coding and design standards, develop and execute tests to validate that the team’s design meets system requirements, and ensure the utmost robustness and quality. You will also be responsible for reviewing and testing the code produced by software engineers.Providing coaching, mentorship, and developmental plans will be a key focus, along with the introduction of new technologies to enhance team capabilities.Your contributions will extend to estimating technical tasks, ensuring compliance with organizational processes and standards, and reviewing technical solutions and estimates provided by presales during proposals.Ownership and responsibility for the continuous improvement of organizational practices and processes will be paramount.

Role Overview:The Lead DevOps Engineer is responsible for overseeing the products and services lifecycle, from initial conception to ongoing operations. This role is integral to our teams, emphasizing the operational dimensions of our offerings. As a developer with substantial hands-on experience in complex technical operations, especially within native-cloud environments, you will play a pivotal role in shaping our solutions.Core Responsibilities:Automate systems and architectures to enhance efficiency.Drive organizational automation initiatives utilizing Infrastructure as Code (IaC) principles.Continuously seek innovative methods to resolve technical challenges and design effective solutions, challenging existing norms.Collaborate with the Product Owner to construct reusable and scalable components.Take ownership of environments and products, ensuring high operational standards.Report directly to the Engineering Lead.Qualifications:Key Skills:8-10 years of experience in DevOps, CI/CD, and containerization.Proficient in building and scaling native-cloud microservices containers, particularly using Kubernetes, OpenShift, Cisco Container Platform, and/or VMware Tanzu Kubernetes Grid.Adept at making significant architectural decisions at both team and product levels.Extensive experience with Linux and best security practices.Proficient in Docker and Kubernetes for containerization.Skilled in scripting languages such as Bash and PowerShell, and programming languages like Java, Python, Node.js, or Go.Hands-on experience with Azure DevOps CI/CD and other CI/CD tools.Experienced in database management including NoSQL databases such as MySQL, PostgreSQL, MongoDB, and Redis.Expertise in configuration management tools like Puppet, Ansible, or Salt.Experience in Agile Development methodologies, with specific experience in Solution Architecture preferred.Understanding of the dynamics with Product Owners, Scrum Masters, Design Leads, and broader technical teams.Experience in managing technical priorities within the backlog.Strong communication skills for aligning complex technical decisions across the organization.Act as an active coach and mentor to foster team growth and maximize potential.Exhibit strong leadership qualities, particularly in inspiring and developing team capabilities.Mindset & Behaviors:A high-energy individual passionate about motivating teammates to achieve their full potential.Open to exploring innovative solutions beyond standard practices.Embraces a culture of trust, transparency, and free thought.Willing to challenge the status quo with courage and creativity.

Join us as a Data Streaming Engineer, where you will design and maintain advanced Kubernetes-based event streaming platforms. Your expertise will be essential in ensuring the reliability and performance of our production and development environments, facilitating seamless deployments and precise event tracking. Key Responsibilities:Kubernetes Infrastructure Management:Design, provision, and maintain Kubernetes clusters across diverse environments (cloud, on-premises, hybrid).Monitor and enhance cluster performance while optimizing resource utilization.Diagnose issues and implement solutions to guarantee high availability and stability.Splunk Operations & Engineering:Oversee Splunk infrastructure, including indexers and search heads.Resolve ingestion issues, latency, and indexing delays in distributed settings.Create and maintain SPL queries, saved searches, alerts, and dashboards.Conduct capacity planning, performance tuning, and upgrade planning for Splunk components.Implement data onboarding strategies and field extractions for new log sources.Cribl Pipeline Management:Experience with Cribl is advantageous but not mandatory.Design, build, and optimize Cribl pipelines for log routing, transformation, filtering, and enrichment.