Data Streaming Engineer

Join us as a Data Streaming Engineer, where you will design and maintain advanced Kubernetes-based event streaming platforms. Your expertise will be essential in ensuring the reliability and performance of our production and development environments, facilitating seamless deployments and precise event tracking. Key Responsibilities:Kubernetes Infrastructure …

Join Contentsquare, a pioneering experience intelligence platform that empowers organizations to understand every facet of their customers’ digital journeys. Our adaptable and robust platform provides deep insights, enabling businesses to enhance their online presence and customer interactions.As a recognized leader in experience analytics, we operate across 15 global offices and are committed to continuous growth. We seek innovative team members who are eager to make a significant impact and help us scale our operations.At Contentsquare, we foster an inclusive workplace that promotes learning and success for all. Our community comprises bold, empathetic, and intentional individuals. We invite you to collaborate with us in simplifying the complex for our clients, their customers, and each other.Important note: Beware of scammers impersonating Contentsquare. We will never request payment or contact you through random messages. For more details, visit our careers blog.#LI-FB1In our Data Infrastructure team, we manage billions of events daily and analyze hundreds of terabytes of data in real time.We are actively seeking both mid-level and senior engineers to join our passionate and skilled team, tasked with designing and developing the next generation of our data architecture, delivering real-time insights at an unparalleled scale.Your daily responsibilities will include:- Leading large-scale projects that involve intricate systems utilizing cutting-edge technologies.- Innovating smart data formats and efficient data exchange methods to enhance product functionality while optimizing cost and performance.- Elevating the team's expertise by introducing new ideas and mentoring fellow developers, leveraging various open-source technologies such as Scala, Go, Kafka, and ClickHouse.Why join Contentsquare's Data Engineering team?- Engage in diverse and exciting projects that will transform analytics and user experience through big data.- Challenge yourself by developing distributed infrastructures in a fast-paced, data-intensive environment.- Benefit from an atmosphere where you can be a technical authority in your areas of expertise, while taking on responsibilities in strategic corporate initiatives and collaborating with peers.

Join our dynamic team as a Senior Data Engineer, where you will harness the power of data to drive impactful solutions. You will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our mission of fostering inclusivity in technology.Your expertise will help us analyze and interpret complex data sets, ensuring data integrity and optimizing data flows. If you are passionate about utilizing data to enhance decision-making and drive business outcomes, we want to hear from you!

Enhancing Data Quality and Reliability:• Develop and implement advanced methodologies to boost the reliability and quality of data.• Integrate raw data from diverse sources to form consistent and machine-readable formats.Structural Development:• Design, develop, and test data structures that facilitate data extraction and transformation for predictive and prescriptive modeling.Process Definition:• Establish and oversee development, testing, release, update, and support processes for data engineering operations. Analyze and resolve code issues effectively.Big Data Models:• Create and optimize big data models and use cases based on the established data structure, preparing them for end-user data operations.Query Execution:• Formulate and execute queries on both structured and unstructured data sources to diagnose process issues and perform bulk updates.Feature Layer Development:• Design and implement the feature zone with essential features and KPIs required by various stakeholders, aiding in the construction of robust machine learning models.Batch Scheduling and Reporting:• Ensure accurate and timely batch production scheduling and report distribution.Ad Hoc Requests:• Address ad hoc requests from users, such as data research, file manipulation and transfer, as well as investigating process issues.

Join our dynamic team as an Azure Data Engineer, where you'll leverage your expertise to evaluate and transform complex data sources, both SAP and non-SAP, into actionable business insights. Your role will involve developing and integrating these data sources into our cutting-edge Azure Data platform, ensuring that our analytics capabilities stay ahead of the curve. Key Responsibilities:• Conduct in-depth analyses of structured, semi-structured, and unstructured data sources to assess quality, completeness, and business impact.• Create, document, develop, implement, and test rapid prototypes demonstrating the value of data, showcasing your work to varied audiences.• Engage in early-stage design and feature definition processes.• Develop robust data pipelines using the Microsoft toolset and Databricks Stack, ensuring they are reusable and scalable.• Collaborate effectively with multidisciplinary engineering teams to integrate proven prototypes into production.

Join our dynamic team at SanaCommerce as a Senior Data Engineer. In this critical role, you will leverage your expertise in data engineering to build robust data pipelines and enhance our data processing capabilities. Collaborate with cross-functional teams to design and implement innovative solutions that drive data-driven decision-making across the organization.

About Us:At Xenon7, we unite exceptional tech talent with world-class opportunities! Collaborating with top-tier enterprises and innovative startups, we engage in exciting, cutting-edge projects that utilize the latest technologies across various IT domains, including Data, Web, Infrastructure, AI, and more. Our expertise in developing IT solutions and providing on-demand resources enables us to partner with clients on transformative initiatives that drive innovation and business growth. Whether empowering global organizations or collaborating with pioneering startups, we are dedicated to delivering advanced, impactful solutions that address today's most intricate challenges.About the Client:Become part of one of Egypt's leading financial institutions, celebrated for its comprehensive range of banking services, including Institutional Banking, Personal Banking, and Islamic Banking. With a global footprint through over 50 branches and correspondents, our diverse and dynamic clientele is at the forefront of our operations. As we embark on a revolutionary digital transformation journey, we are committed to leveraging cutting-edge technologies to build a state-of-the-art data architecture that will redefine our performance and service delivery.Position Overview:We are looking for a driven and experienced Senior Data Engineer to join our expanding data team. In this pivotal role, you will design and develop scalable, high-performance data pipelines and lakehouse architectures. Collaborating closely with data modelers, analysts, and business stakeholders, you will deliver reliable real-time and batch-based data solutions that are integral to our analytics and AI-driven strategies.

Role Overview PetroApp is seeking a Lead Data Engineer in Cairo to shape and advance the company’s data capabilities. This senior role influences PetroApp’s data strategy, working across analytics, business intelligence, engineering, governance, and advanced analytics. The Lead Data Engineer partners closely with Product, Engineering, Operations, Commercial, Finance, and Leadership to position data as a strategic asset for the company. This position focuses on building a solid data foundation, establishing KPIs, and enabling data-driven decisions. Key applications include transaction analytics, customer growth, fraud detection, operational improvements, and unit economics. Main Responsibilities Define and guide PetroApp’s data strategy, roadmap, and operational approach. Develop and scale data infrastructure for ingestion, transformation, modeling, warehousing, and self-service analytics. Establish a single source of truth for essential business and product metrics. Work with Product and Engineering to improve instrumentation, event tracking, experimentation, and measurement. Partner with Commercial, Operations, Finance, and Leadership to deliver actionable insights and clear dashboards. Design KPI frameworks covering customer growth, retention, transaction performance, service adoption, operational efficiency, fraud prevention, and profitability. Build dashboards, reporting layers, and analytical models that support daily operations and long-term strategy. Implement data governance practices, including quality checks, lineage tracking, documentation, access controls, and privacy compliance. Identify and prioritize advanced analytics use cases such as forecasting, anomaly detection, and process automation. Conduct root-cause analysis on business or operational challenges and translate findings into practical strategies. Recruit, mentor, and develop a high-performing data team over time. Champion a strong data culture throughout PetroApp.

About UsWelcome to Foodics! We are a premier restaurant management ecosystem and payment technology provider, established in 2014. With our headquarters in Riyadh and operations spanning five countries—including the UAE, Egypt, Jordan, and Kuwait—we proudly serve customers and partners across over 35 nations. Our cutting-edge products have facilitated the processing of more than 6 billion orders, establishing Foodics as one of the fastest-growing SaaS firms in the MENA region. Recently, we achieved a significant milestone with our third funding round, raising $170 million, which marks the largest SaaS funding in MENA to date, further enhancing our innovation capabilities to better serve business owners.Role OverviewAs a Senior Data Engineer, you will play a pivotal role in designing and constructing robust data pipelines, data contracts, and processing frameworks that drive analytics and machine learning capabilities at Foodics. You will collaborate closely with ML Engineers and platform teams to ensure our data infrastructure is reliable, scalable, and governed effectively.Your ResponsibilitiesArchitect and implement scalable ETL/ELT pipelines utilizing cloud-native solutions.Establish and uphold data contracts with domain squads and internal stakeholders.Partner with ML Engineers to facilitate feature engineering and prepare model-ready datasets.Develop monitoring, alerting, and observability mechanisms for the data infrastructure.Ensure compliance with data security, lineage, and internal governance standards.Contribute to onboarding toolkits and reusable data components.Qualifications We Seek5+ years of experience in data engineering with proven expertise in building scalable pipelines.Proficient in Python, SQL, and orchestration tools such as Airflow, AWS Glue, or Step Functions.Experience with modern Lakehouse architectures and tools (e.g., S3, Redshift, Snowflake, dbt).Strong understanding of data modeling, lineage, observability, and governance frameworks (e.g., dimensional modeling, normalized vs. denormalized structures).Familiarity with ACID-compliant data formats like Apache Iceberg, Delta Lake, or Apache Hudi, and experience managing large-scale datasets with features such as time travel and schema evolution.Expertise in building fault-tolerant, testable, and maintainable pipelines in production settings.Demonstrated ability to collaborate effectively within cross-functional teams, including ML Engineers, Analysts, and Product Managers.Familiarity with CI/CD and infrastructure-as-code tools (Terraform/CDK preferred).Excellent communication skills with a focus on documentation, standards, and continuous improvement.Ideal Candidate TraitsKnowledge of MLOps integration and streaming technologies is a plus.

Data Pipeline Development & InfrastructureArchitect, develop, and sustain robust and scalable data pipelines that support both structured and unstructured data.Create and implement real-time and batch data processing frameworks.Develop ETL/ELT workflows for data ingestion from diverse sources, ensuring optimal performance and reliability.Enhance data storage and retrieval mechanisms for real-time and batch operations.Design a cost-effective and efficient data infrastructure that adapts to the evolving needs of the business.Data Solutions & AI-Driven ApplicationsConstruct data pipelines to support machine learning recommenders, search functionalities, and AI-enhanced features.Develop and maintain data models, APIs, and integrations that facilitate analytics and customer applications.Support eCommerce data solutions such as product recommendations, customer segmentation, and personalization strategies.Collaboration & Continuous ImprovementCollaborate with Data Architects, Analysts, and Product Teams to identify data requirements and deliver top-tier solutions.Monitor and resolve performance issues to maintain high availability and efficiency of data pipelines.Continuously enhance the cost, performance, and scalability of data engineering solutions.

Key ResponsibilitiesArchitect and implement scalable and dependable data pipeline solutions.Prioritize and manage daily tasks in alignment with sprint planning outcomes.Collaborate with various commercial teams to deliver tailored customer offerings.Guarantee timely delivery of high-quality outputs.Plan releases and provide comprehensive support for deployed packages.

Envision Employment Solutions is on the lookout for a skilled Data Operations and Support Engineer to join our esteemed partner, a renowned global leader in IT Services and Consulting.Job SummaryThe Data Operations and Support Engineer will play a crucial role in ensuring the seamless operation and support of enterprise data platforms and integrations. This includes monitoring, troubleshooting, and maintaining production workflows across various systems such as SAP PO, Informatica, and Cloudera, while upholding data integrity and ensuring timely issue resolution.Key ResponsibilitiesOversee the end-to-end implementation of data strategies to support enterprise data management functions.Utilize supporting tools and logs to identify and present root causes of data issues across different functions.Manage the processes of production data operations, deployments, documentation, and data population to ensure compliance with corporate data management standards.Collaborate closely with data functions to ensure all support processes adhere to bank policies, internal controls, data protection legislation, and relevant industry standards.Identify opportunities for process efficiency and improvement, proposing and implementing data automation initiatives.Foster strong collaborative relationships with internal stakeholders, subject matter experts, clients, and vendors.Implement and oversee data backup, restore, and archiving solutions.Ensure data availability throughout its lifecycle.Monitor and manage the performance of data solutions, layers, and transactions.Align database standards from DBA to data support requirements across management layers.Support new data products and participate in new project initiatives.

Role OverviewWe are seeking a highly skilled Data Engineer Team Lead to spearhead the design and validation of robust data pipelines, data structures, and cutting-edge big data solutions, including data lake platforms. This role is crucial for optimizing data search and retrieval processes within our organization. You will collaborate closely with data structure designers to establish a comprehensive enterprise data architecture.Key ResponsibilitiesEnhancing Data Quality and Reliability:* Develop and implement innovative strategies to enhance data reliability and quality.* Integrate raw data from diverse sources to produce consistent, machine-readable formats.Data Structure Development:* Lead the design and testing of data structures that facilitate effective data extraction and transformation for predictive and prescriptive analytics.Process Definition:* Establish and manage development, testing, release, and support processes for data engineering operations. Identify and rectify code bugs as necessary.Big Data Model Development:* Oversee the creation of big data models and use cases that are aligned with data structures, preparing them for seamless data operations.Query Execution:* Formulate and execute queries on both structured and unstructured data sources to diagnose process issues or conduct bulk updates.Feature Layer Implementation:* Direct the development and implementation of feature zones with essential features and KPIs requested by stakeholders to support robust machine learning models.Batch Scheduling and Reporting:* Ensure accuracy and timeliness in batch production scheduling and report distribution.Data Transformation Management:* Design and oversee processes that support data transformation, data structures, metadata management, dependency tracking, and workload management.Required Competencies* Performance Excellence* Leadership & Empowerment* Collaboration & Synergy Creation* Agility & Resilience* Innovation & Digital Transformation* Strategic Thinking* People-Centric ApproachTechnical Skills* Strong proficiency in Java, C#, and Python for application development.* Extensive experience with Cloudera or comparable big data platforms, including services like Apache Hive, Apache Scala, BizSpark, Impala, Apache Spark, Data Security, Kafka, HBase, Sqoop, NiFi, and Python for programming and data analysis.* Expertise in handling and processing large datasets using distributed computing frameworks.* Advanced SQL skills for querying and managing relational databases.* Comprehensive understanding of data warehousing principles and best practices.* Proficiency in data analysis and visualization tools.

Become a part of EVA Pharma, a pioneering pharmaceutical organization committed to championing health and well-being as an essential human right. Celebrated for our exceptional workplace culture, we strive to cultivate an environment that encourages support and innovation among our team members.Job Overview: We are in search of a driven and skilled Senior Lead Data Engineer to integrate into our vibrant team. The successful candidate will play a crucial role in our mission to advance human health and well-being, ensuring we uphold the highest standards of excellence within our sector. Primary Responsibilities:Architect, develop, and sustain robust ETL/ELT pipelines that transfer data from various sources into cloud-based data warehouses such as Snowflake, BigQuery, or Databricks. Guarantee real-time or near-real-time data processing for analytical dashboards and operational systems while continuously optimizing performance to adeptly manage increasing data volumes.Establish automated validation protocols, anomaly detection mechanisms, and alerting systems to uphold superior data accuracy. Ensure all pipelines adhere to data privacy and security regulations (e.g., GDPR, SOC 2). Maintain comprehensive documentation and data lineage to facilitate audits and cross-team transparency.Assess and implement new tools like Airflow, dbt, Kafka, or Spark to enhance operational efficiency and scalability. Collaborate with AI/ML teams to support the deployment and integration of sophisticated models.Create best practices for data modeling, storage efficiency, and version control. Align data structures with critical business metrics and analytical applications to ensure consistency across various departments.Conduct design evaluations, uphold high-quality coding standards, and promote a collaborative environment centered on innovation and ongoing enhancement. Additionally, mentor and guide fellow data engineers to refine their technical expertise and boost project outcomes.

b_labs serves as the transformative and digital innovation arm of B.TECH, dedicated to revolutionizing the industry landscape. As a key player in technological advancement within B.TECH, a pivotal entity in the Egyptian retail sector, we are committed to propelling B.TECH toward its vision of becoming the foremost omni-channel platform for consumer electronics and appliances in Egypt. By joining b_labs, you will thrive in a collaborative startup atmosphere while benefiting from the stability of a company that consistently achieves remarkable growth. You will become a vital member of a forward-thinking, customer-centric team with a bold mission to lead the digital retail transformation across the Middle East.Key Responsibilities:Design, implement, and manage large-scale, reliable data pipelines utilizing Python, SQL, and big data technologies such as Apache Spark and Kafka.Build and refine ETL/ELT processes for data transformation, loading, and integration from diverse sources.Develop and maintain robust data storage solutions leveraging both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB.Establish and oversee CI/CD pipelines for data workflows, facilitating automated deployments and version control.Utilize AWS services to create, deploy, and monitor scalable cloud-based data solutions.Employ Apache Airflow for workflow orchestration and use PostHog for analytics tracking and event data management.Enhance data warehousing solutions to meet business intelligence and analytics requirements.Ensure data integrity, consistency, and security across multiple systems and sources.Troubleshoot and optimize data systems for enhanced performance, scalability, and cost efficiency.Foster and contribute to a collaborative, innovative, and agile team culture.

mylo is an innovative fintech platform dedicated to empowering millions of individuals and businesses by offering accessible and responsible financial solutions. Whether you're acquiring a mobile phone, purchasing a stylish jacket, booking a flight, or covering educational expenses, mylo allows you to buy now and pay later at countless points of sale throughout Egypt. Originating from B.TECH—Egypt’s premier electronics and appliance retailer with over 27 years of experience in providing buy now, pay later options—mylo carries a legacy of trust and creative solutions in the fintech realm. All mylo products are fully Sharia-compliant, ensuring ethical and inclusive financial practices.We are on the lookout for a dedicated and skilled Senior Data Engineer to enhance our team within the Fintech sector. This role is perfect for someone who excels in a dynamic environment and is eager to design, build, and scale secure, high-performance infrastructure to support a variety of financial products.Responsibilities Design, develop, and maintain large-scale, reliable data pipelines utilizing Python, SQL, and big data technologies such as Apache Spark and Kafka. Build and optimize ETL/ELT processes for data transformation, loading, and integration from diverse sources. Develop and maintain data storage solutions using both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB. Implement and manage CI/CD pipelines for data workflows, facilitating automated deployments and version control. Utilize AWS services to construct, deploy, and monitor cloud-based, scalable data solutions. Leverage Apache Airflow for orchestrating workflows and PostHog for analytics tracking and event data. Oversee and enhance data warehousing solutions to meet business intelligence and analytics requirements. Ensure data accuracy, consistency, and security across various systems and sources. Troubleshoot and optimize data systems for performance, scalability, and cost efficiency. Actively foster and contribute to a collaborative, innovative, and agile team culture.

Job ResponsibilitiesArchitect and sustain data pipelines tailored for ML/AI workloads, effectively managing large-scale, unstructured, and semi-structured data sets.Create feature pipelines and stores to ensure data reusability and consistency for machine learning initiatives.Work alongside Data Scientists and ML Engineers to define data needs for training, validation, and deployment of models.Guarantee data quality, lineage, and governance align with standards necessary for AI/ML applications.Facilitate MLOps practices by integrating data pipelines with model training, monitoring, and deployment processes.Utilize distributed processing frameworks (e.g., Spark, Databricks, Azure Synapse) for scalable ML data processing.

b_labs serves as the transformative and digitization division of B.TECH, dedicated to revolutionizing the industry landscape. Our focus lies in driving technological innovation at B.TECH, a pillar of the Egyptian retail sector, as we strive to establish ourselves as the foremost omni-channel platform for consumer electronics and appliances in Egypt. By becoming a part of b_labs, you will experience the dynamic atmosphere of a startup while benefiting from the stability of a well-established company that has consistently demonstrated robust growth. You will join a forward-thinking, customer-centric team with a bold objective: to lead the digital retail transformation across the Middle East.

Join Our Dynamic Team!At Integrant, we are seeking innovative minds to step into the role of Senior Data Architect. In this pivotal position, you will be tasked with architecting comprehensive solutions for data ingestion, storage, processing, transformation, enrichment, and presentation tailored for analytical insights. Your responsibilities will encompass gathering requirements, selecting and customizing analytical frameworks to meet client demands, designing and constructing data pipelines, and formulating data strategies. You will also mentor clients and internal teams on cutting-edge architectures (such as Data Warehouses, Data Lakes, Data Lakehouses, Data Fabrics, Data Meshes) and methodologies (including DataOps and MLOps).

Role OverviewAs a Senior Data Engineer specializing in Machine Learning (ML) and Artificial Intelligence (AI), you will be instrumental in developing and sustaining data pipelines tailored for ML/AI applications. Your efforts will focus on managing extensive datasets, including unstructured and semi-structured information, to ensure our analytics and machine learning initiatives are grounded in high-quality data.Your ResponsibilitiesDesign, implement, and optimize data pipelines specifically for ML/AI scenarios, ensuring effective handling of large-scale datasets.Construct feature pipelines and feature stores that promote data reusability and consistency for machine learning models.Work closely with Data Scientists and ML Engineers to clarify data needs for model training, validation, and deployment.Guarantee that data quality, lineage, and governance adhere to the standards necessary for AI/ML applications.Facilitate MLOps practices by integrating data pipelines into model training, monitoring, and deployment processes.Utilize distributed processing frameworks (e.g., Spark, Databricks, Azure Synapse) for scalable ML data processing.