Senior Software Engineer - Data Pipeline

Join SoFi as a Senior Software Engineer in our Data Foundations team, where you will play a pivotal role in shaping our data architecture and enhancing our data-driven capabilities. You will work closely with cross-functional teams to develop robust data solutions that empower our business decisions and improve customer experiences.As a Senior Software Engin…

Founded in 2007, Airbnb has transformed the way people travel and connect. From humble beginnings with just three guests in a San Francisco home, we have grown to a global community of over 5 million hosts who have welcomed more than 2 billion guest arrivals across nearly every country. Our hosts provide unique accommodations and experiences that foster authentic connections with local communities.Join Our Talented Community:As a member of Airbnb's App Foundation team, you will collaborate across platforms to create high-quality, performant capabilities that enhance nearly all features within the Guest and Host ecosystems.Our primary focus is on developing App Product Frameworks, Insights & Logging, Performance & App Health, and Feature Architecture. We work hand in hand with Product, Design, Platform (iOS/Android/Web), Analytics Infrastructure, Data Platform, and other Product Foundation teams to establish cohesive paved paths and standards at scale. We pride ourselves on a culture that values technical excellence, pragmatic decision-making, robust ownership, and a steadfast commitment to enhancing both developer and user experiences through foundational work.Your Impact:Collaborate with cross-functional partners (design and product) to explore, shape, and implement new product experiences from ideation to large-scale execution.Develop efficient and reusable backend capabilities that prioritize quality while ensuring performance and scalability.Lead initiatives that significantly enhance Guest and Host experiences by improving app responsiveness and ensuring reliable performance across critical backend systems impacting millions.Establish a performance roadmap by identifying bottlenecks, prioritizing impactful work, and delivering enhancements across services, data access patterns, and infrastructure.Elevate performance engineering standards by creating tools, benchmarks, and guardrails that prevent regressions and integrate performance considerations into team workflows.Influence architecture and standards across Airbnb's backend ecosystem to improve observability, efficiency, and adaptability of systems.A Day in Your Life:Join us in making a difference for millions of users worldwide by building the backend foundations that power the Airbnb experience.

Join Our MissionFoundation is on the lookout for exceptional engineers to propel our mission of modernizing the homebuilding industry and enhancing the journey of purchasing, selling, and owning homes.About UsWith an impressive backing of $6.8 million from top venture capitalists, including Y Combinator, Foundation is formed by a team of former Opendoor professionals dedicated to revolutionizing residential real estate.Our flagship product serves as a pioneering customer experience platform tailored for homebuilders, akin to “Shopify for Homebuilders.” We collaborate with large-scale homebuilders to provide a cutting-edge digital customer experience, significantly boosting customer satisfaction and team productivity. In just two years, we’ve achieved notable product-market fit and rapid growth, supported solely by contract design.Our Growth PhasesWe are currently navigating the first of three interconnected growth phases:Innovative, AI-driven vertical SaaS for homebuilding - a public-scale potential in its own right.The enterprise ecosystem for real estate - enabling collaboration among adjacent trillion-dollar industries including lending, title, home insurance, and home services.The AI-native home operating system and interface - leveraging the network effects of the enterprise ecosystem to deliver transformative AI experiences for homebuyers and homeowners. Discover, purchase, and manage your home seamlessly with Foundation.Your RoleIn this pivotal role, you will contribute to creating the most reliable and modern customer experience platform within the homebuilding sector, transitioning traditional workflows into the AI era with insight, pragmatism, and empathy.You will work closely with product and customer teams, engaging in comprehensive stack development, collaborating with design and go-to-market teams, and owning significant portions of the platform from initial discovery to production refinement. Our focus is on real businesses, real revenue, and real users who require robust and reliable tools.

About GranicaGranica is an innovative AI research and infrastructure firm dedicated to creating reliable and steerable representations of enterprise data.We build trust through our product Crunch, a policy-driven health layer that ensures large tabular datasets remain efficient, reliable, and reversible. On this solid foundation, we are developing Large Tabular Models—systems designed to learn cross-column and relational structures in order to provide trustworthy answers and automation with inherent provenance and governance.Our MissionAI is currently hampered not only by the design of models but also by the inefficiencies of the data that supports them. Every redundant byte, poorly organized dataset, and inefficient data pathway contributes to significant costs, latency, and energy waste as we scale.Granica aims to eliminate these inefficiencies. We merge cutting-edge research in information theory, probabilistic modeling, and distributed systems to craft self-optimizing data infrastructures: systems that consistently enhance the representation and utilization of information by AI.Our engineering team collaborates closely with the Granica Research group led by Prof. Andrea Montanari of Stanford University, bridging advancements in information theory and learning efficiency with large-scale distributed systems. Together, we firmly believe that the next major advancement in AI will stem from breakthroughs in efficient systems rather than merely larger models.Your ContributionsGlobal Metadata Substrate: Design a transactional and metadata substrate that facilitates time-travel, schema evolution, and atomic consistency across massive petabyte-scale tabular datasets.Adaptive Engines: Develop systems that autonomously reorganize data, learning from access patterns and workloads to maintain peak efficiency without the need for manual tuning.Intelligent Data Layouts: Optimize bit-level organization (including encoding, compression, and layout) to maximize signal extraction per byte read.Autonomous Compute Pipelines: Create distributed compute systems that scale predictably, adapt to dynamic loads, and ensure reliability under failure conditions.Research to Production: Apply new algorithms in compression, representation, and optimization that emerge from ongoing research. We encourage opportunities to publish and open-source your work.Latency as Intelligence: Design systems that inherently minimize latency as a measure of intelligence.

About Our TeamThe Applied Foundations team at OpenAI is at the forefront of safeguarding our innovative technology against diverse adversarial threats. Our primary mission is to ensure the integrity and security of our platforms as they grow.We are dedicated to defending against financial misuse, large-scale attacks, and other forms of exploitation that could compromise user experience or destabilize our operations. The Integrity Foundations team lays the groundwork and infrastructure to support this critical mission.About the RoleAt OpenAI, we aim to advance artificial intelligence in a manner that is safe, reliable, and aligned with broader societal values. The role of Software Engineer in Applied Foundations is vital for maintaining the dependability of our platforms. You will play a key role in developing strong defenses against a variety of adversarial behaviors that threaten our ecosystem.In this position, you will collaborate with our entire engineering team to design and implement systems that detect and prevent abuse, promote user safety, and mitigate risks across our platform. You will be at the forefront of our initiatives to responsibly and sustainably harness the vast potential of AI.Key Responsibilities:Design and enhance systems to identify and prevent various forms of abuse, including financial fraud, botting, and scripting.Work collaboratively with cross-functional teams to create solutions that defend against adversarial attacks while preserving an optimal user experience.Assist in responding to active incidents on the platform and develop new tools and infrastructure to address fundamental challenges.You will excel in this role if you:Possess a minimum of 3 years of professional experience in software engineering.Have experience in setting up and maintaining production backend services and data pipelines.Exhibit a humble attitude, a willingness to support colleagues, and a commitment to team success.Demonstrate self-direction and enjoy innovating solutions to complex problems.Take ownership of issues from start to finish and are eager to acquire any necessary knowledge to achieve your goals.Have a passion for AI safety in production environments and the skills to build effective software systems.

Okta secures identity for both people and AI, providing trusted infrastructure that helps organizations adapt to change. The company addresses complex, real-world problems with practical solutions and values urgency, excellence, and teamwork. The Developer Foundations team is looking for a Staff Software Engineer based in San Francisco, California. This engineer will play a key role in scaling Okta’s systems and accelerating software delivery. The position centers on refining the company’s approach to Continuous Delivery and driving improvements in engineering velocity and productivity across multiple teams. Collaboration is central in this role. The Staff Software Engineer works closely with engineers, architects, operations, program management, and quality assurance. The team values fresh ideas and solutions that have a direct impact on internal developer experience. What you will do Create high-quality internal tools and automation that support continuous delivery and boost developer productivity. Design and implement Continuous Delivery pipelines for a range of projects, using technologies such as Java, Jenkins, AWS, Docker, Python, Node, iOS, Ruby, Bash, and Go. Develop proof of concepts, guide technology decisions, contribute to internal frameworks, and participate in design and code reviews. Roll out solutions to internal users in phases, monitor adoption, gather feedback, and refine approaches to fit team needs. Maintain pre-production infrastructure on AWS, focusing on monitoring, backup and restore, SLA management, cost control, and deployment processes.

Join Intuitive Surgical as a Data Engineer focused on our Machine Learning Platform and Data Foundations. In this pivotal role, you will harness the power of data to drive innovations that enhance surgical outcomes. Collaborate with cross-functional teams to design, develop, and implement data solutions that empower our Machine Learning initiatives.

Join Us as Our First Marketing LeadFoundation is on the lookout for our inaugural marketing leader to propel our vision of revolutionizing homebuilding and enhancing the journey of buying, selling, and owning a home.About FoundationWith approximately $6.8M in backing from top-tier venture capitalists, including Y Combinator, Foundation is composed of a dynamic team formerly from Opendoor, dedicated to reshaping the future of residential real estate.Our flagship product is a cutting-edge customer experience platform designed specifically for homebuilders—think of it as the "Shopify for Homebuilders." We collaborate with large-scale homebuilders to deliver a modern digital experience, significantly boosting customer satisfaction and team productivity. In just two years, we've achieved remarkable product-market fit and impressive growth, all without a dedicated marketing team.Our Growth JourneyWe are currently navigating the first of three interconnected growth phases:AI-Driven SaaS for Homebuilding: A transformative opportunity with public-scale potential.Real Estate Enterprise Ecosystem: Homebuilders drive this ecosystem, which fosters collaboration among adjacent trillion-dollar sectors such as lending, title, home insurance, and retail.AI Native Home Operating System: This will enable seamless home buying and ownership through our platform.Your Role as Our First MarketerWe seek a hands-on, results-driven marketer passionate about transforming a key sector of the U.S. economy and redefining marketing in the age of AI.Key ResponsibilitiesYou will be pivotal in steering Foundation's next growth phases by integrating AI with marketing and real estate innovation. Your primary objectives will include:Accelerating Growth: Drive rapid expansion of our core AI-driven product line for homebuilders.

Join Zip as a talented Software Engineer in our AI Foundation team, where you'll play a crucial role in developing innovative AI solutions. This position offers the opportunity to work on cutting-edge technologies and contribute to projects that impact millions. If you have a passion for artificial intelligence and software development, we want to hear from you!

About RoxAt Rox, we are pioneering the development of an AI-native revenue operating system that transforms how enterprises interact with technology. Unlike traditional software designed for human dashboard operators, Rox is engineered for agents managing complex systems.We eliminate static workflows, enabling continuous decision-making processes powered by real-time insights from across the enterprise landscape. Our agents are equipped to analyze signals, reason through them, and autonomously execute actions.To support this innovation, we are constructing a robust infrastructure that integrates:Distributed data platformsReal-time decision-making systemsAgent execution frameworksLow-latency context retrievalBacked by prominent investors like Sequoia, GV, and General Catalyst, we are assembling a talented team of engineers eager to tackle deep technical challenges that have a tangible impact on the world.About the Foundations TeamThe Foundations team is responsible for developing the core infrastructure that powers Rox agents.Our work focuses on:Real-time context ingestionAgent execution and orchestrationEnsuring reliability for long-term AI tasksLow-latency decision-making across distributed systemsIf you have experience with:Streaming compute platformsDistributed query enginesReal-time OLAP systemsMatching enginesLarge-scale data infrastructureMany challenges you encounter here will resonate with your past work but will be applied to a novel category of software. At Rox, agents continuously:Retrieve contextMake decisionsTrigger actionsUpdate stateThe Foundations team builds the infrastructure that ensures these feedback loops are reliable, swift, and observable.The RoleWe are on the lookout for a Foundations Engineer (Deep Infrastructure) to design and oversee the systems that power Rox's agent runtime.

About Plaid Plaid builds tools that help developers create new financial products and experiences. Since 2013, Plaid has connected millions of users to over 12,000 financial institutions across the US, Canada, the UK, and Europe. The company partners with organizations like Venmo, SoFi, Fortune 500 firms, and major banks to make linking financial accounts to apps and services easier. Headquarters are in San Francisco, with offices in New York, Washington D.C., London, and Amsterdam. Team: Data Foundation & AI The Data Foundation and AI team designs and maintains the machine learning and AI infrastructure that supports Plaid’s products. This group transforms Plaid’s financial network data into flexible formats used by teams across the company. Responsibilities span the entire system lifecycle: data curation for pretraining, model development, deployment, serving, and monitoring in production. Role Overview: Senior Machine Learning Engineer (Research Scientist) This position focuses on applied research for Plaid’s foundation model. The Senior Research Scientist leads efforts to design model architectures, set pretraining objectives, and implement fine-tuning strategies that work across a range of product needs. The role also involves building and maintaining production machine learning systems, including training pipelines, model serving, feature engineering, and performance monitoring. Key Responsibilities Design model architectures and define pretraining objectives for Plaid’s foundation model Develop and apply fine-tuning methods for diverse product use cases Build and maintain end-to-end machine learning systems, from data pipelines to model serving Engineer features and monitor system performance in production Create evaluation frameworks to measure model quality across multiple tasks and metrics Location This role is based in San Francisco.

Join Our Team as a Customer Success Manager/Lead!At Foundation, we're on a mission to revolutionize the homebuilding industry and enhance the experience of buying, selling, and owning homes. We are looking for a dedicated Customer Success Manager to join our dynamic team and drive our core business forward.About UsWith $6.8M in funding from top-tier venture capitalists, including Y Combinator, Foundation is comprised of a talented team formerly from Opendoor, focused on transforming residential real estate. Our flagship product is a cutting-edge customer experience platform tailored for homebuilders — envision it as the 'Shopify for Homebuilders'. We partner with large-scale homebuilders to provide a modern digital experience that significantly boosts customer satisfaction and team productivity. Within just two years, we have achieved remarkable growth and established a strong product-market fit.The RoleAs a Customer Success Manager, you will play a pivotal role in fostering and expanding relationships with our diverse portfolio of clients. You will be the primary contact for our customers post-onboarding, ensuring they maximize their use of our platform and derive long-term value. This position requires a proactive approach in managing multiple accounts, identifying risks and opportunities, and collaborating closely with our Product, Engineering, and Operations teams.This is an ideal opportunity for someone who thrives in a fast-paced environment, enjoys tackling challenges, and seeks a meaningful role within a scaling startup. You will have the autonomy to influence our customer engagement strategies and drive significant impact.

About GranicaGranica is a pioneering AI research and infrastructure company dedicated to creating reliable and steerable representations of enterprise data.We build trust through Crunch, a policy-driven health layer designed to keep extensive tabular datasets efficient, reliable, and reversible. From this foundation, we are developing Large Tabular Models—systems that learn cross-column and relational structures to provide trustworthy answers and automation, complete with built-in provenance and governance.Our MissionThe current limitations of AI are not solely due to model design but also to the inefficiencies of the data that supports it. At scale, every redundant byte, poorly organized dataset, and inefficient data path contributes to significant costs, latency, and energy waste.Granica’s mission is to eliminate these inefficiencies. We leverage cutting-edge research in information theory, probabilistic modeling, and distributed systems to create self-optimizing data infrastructures that continuously enhance how information is represented and utilized by AI.Our engineering team collaborates closely with the Granica Research group led by Prof. Andrea Montanari from Stanford University, merging advancements in information theory and learning efficiency with large-scale distributed systems. We believe that the next major breakthrough in AI will stem from innovations in efficient systems, rather than simply larger models.What You Will CreateGlobal Metadata Substrate. Design and refine the global metadata and transactional substrate that enables atomic consistency and schema evolution across exabyte-scale data systems.Adaptive Engines. Architect systems that self-optimize, reorganizing and compressing data according to access patterns, achieving unprecedented efficiency improvements.Intelligent Data Layouts. Innovate new encoding and layout strategies that challenge the theoretical limits of signal per byte read.Autonomous Compute Pipelines. Spearhead the development of distributed compute platforms that scale predictively and maintain reliability even under extreme load and failure conditions.Research to Production. Partner with Granica Research to transform advances in compression and probabilistic modeling into production-ready, industry-leading systems.Latency as Intelligence. Propel systems forward by optimizing for latency as a key aspect of intelligence.

At Databricks, we are driven by our commitment to empower data teams in tackling the world's most challenging problems — from transforming transportation solutions to accelerating medical advancements. Our mission revolves around constructing and maintaining the world's premier data and AI infrastructure platform, enabling our clients to harness deep data insights for enhanced business outcomes.Foundation Model Serving represents the API product designed for hosting and serving advanced AI model inference, catering to both open-source models like Llama, Qwen, and GPT OSS, as well as proprietary models such as Claude and OpenAI GPT. We welcome engineers who have experience managing high-scale operational systems, including customer-facing APIs, Edge Gateways, or ML Inference services, even if they do not have a background in ML or AI. A passion for developing LLM APIs and runtimes at scale is essential.As a Staff Engineer, you will play a pivotal role in defining both the product experience and the underlying infrastructure. You will be tasked with designing and building systems that facilitate high-throughput, low-latency inference on GPU workloads with cutting-edge models. Your influence will extend to architectural direction, working closely with platform, product, infrastructure, and research teams to deliver an exceptional foundation model API product.The impact you will have:Design and implement core systems and APIs that drive Databricks Foundation Model Serving, ensuring scalability, reliability, and operational excellence.Collaborate with product and engineering leaders to outline the technical roadmap and long-term architecture for workload serving.Make architectural decisions to enhance performance, throughput, autoscaling, and operational efficiency for GPU serving workloads.Contribute directly to critical components within the serving infrastructure, from systems like vLLM and SGLang to developing token-based rate limiters and optimizers, ensuring seamless and efficient operations at scale.Work cross-functionally with product, platform, and research teams to transform customer requirements into dependable and high-performing systems.Establish best practices for code quality, testing, and operational readiness while mentoring fellow engineers through design reviews and technical support.Represent the team in inter-departmental technical discussions, influencing Databricks’ wider AI platform strategy.

About the Applied Foundations Team The Applied Foundations group at OpenAI focuses on protecting our technology from adversarial threats as our platforms grow. This team builds the core infrastructure that helps prevent financial abuse, large-scale attacks, and other forms of misuse that could impact user experience or disrupt operations. Role Overview OpenAI aims to advance AI in a way that is safe, reliable, and aligned with society’s values. As a Full Stack Software Engineer on the Integrity Foundations team in San Francisco, you will help maintain the trustworthiness of our platforms. Your work will involve building defenses against adversarial behaviors and ensuring our ecosystem remains secure. This role collaborates closely with engineering and cross-functional partners to design and implement systems that detect and prevent abuse, enhance user safety, and reduce risks. You will help lead efforts to ensure AI is used responsibly and sustainably. What You Will Do Design APIs for internal workflows that interact with all layers of the stack, supporting informed data model decisions. Build and integrate tools that enable internal teams to investigate safety, abuse, and risk issues, with a focus on strong access controls, auditability, and operational rigor. Work with teams across the company to develop solutions that guard against adversarial attacks while maintaining a positive user experience. Help respond to live incidents on the platform and create new infrastructure to address underlying problems. What We Look For Interest in building high-quality internal tools and a genuine concern for end-users. At least 3 years of professional software engineering experience. Ability to collaborate effectively, including with partners outside engineering. Humility, sound judgment, and a drive for continuous improvement.

About Probably GeneticProbably Genetic is revolutionizing the lives of patients with severe and complex diseases. Our advanced data platform empowers drug developers and patient advocacy organizations to create and launch innovative treatments. By leveraging cutting-edge technology, we identify undiagnosed patients online, analyze their conditions using machine learning and home testing, and facilitate compliant communication with them. Our mission is to ensure that patients gain access to diagnoses, clinical trials, and treatments at the earliest opportunity.We are a dedicated team of passionate problem solvers, driven by a purpose that transcends individual interests. By prioritizing patient welfare, we are developing groundbreaking solutions in healthcare, with a roadmap full of innovations in bioinformatics, AI, and drug development. We invite you to join our lean, talented team and contribute to our vision.Probably Genetic has secured multiple funding rounds from top-tier Silicon Valley investors, including Threshold, Khosla, and Y Combinator. We offer competitive salaries, comprehensive benefits, and meaningful equity opportunities for early-stage team members.About the RoleWe are seeking a founding Data Engineer who is enthusiastic about shaping the future of data utilization to enhance patient outcomes. In this pivotal role, you will establish our data engineering architecture and construct the pipelines that drive internal insights and commercial data products. Your contributions will be instrumental in fostering clarity, impact, and growth throughout our organization.What You Will DoCollaborate closely with the Head of Engineering and Head of Product to transform complex data challenges into elegant, scalable solutions.Build reliable, maintainable infrastructure on AWS using Terraform to accommodate our expanding data requirements.Design data tables and pipelines tailored to the specific needs of our customers and internal teams.Implement state-of-the-art data pipelines with built-in observability from day one.Analyze and visualize data using BI tools to facilitate informed business decisions and provide customized insights to clients.Communicate your work and its impact across teams — presenting findings, receiving feedback, and continuously enhancing processes.Who You AreWe are eager to connect with candidates from diverse backgrounds who are committed to learning, growth, and making a meaningful impact. Here are a few attributes that will enable you to thrive in this role:Proficiency in data engineering principles and practices.Experience with cloud platforms, particularly AWS.Strong analytical skills and familiarity with data visualization tools.Ability to collaborate effectively in a team environment.

About the Foundations Retrieval Team The Foundations Research group at OpenAI explores new approaches that could shape artificial intelligence for years to come. The team focuses on improving the science and data behind model training and scaling, especially for future advanced models. Areas of focus include data utilization, scaling laws, optimization strategies, model architectures, and efficiency improvements. Within Foundations, the Search team builds agentic search solutions. This group works closely with others to design interfaces between models and the core search stack, serving, indexing, and retrieval, so model intent leads to reliable, real-world results. The team develops large-scale systems to transform and index massive information sources, enabling models to reason over global knowledge. Close collaboration with researchers helps move new modeling ideas into production quickly, changing how intelligent systems discover and synthesize information at scale. Role Overview OpenAI is hiring a Software Engineer with expertise in retrieval system development and scalability for its San Francisco office. This role involves working with researchers and engineers to build infrastructure that lets models access the right information when needed. Responsibilities include designing and operating indexing systems, retrieval pipelines, and serving layers. Work in this role will directly improve retrieval capabilities across OpenAI’s research and products, with a strong influence on system performance, reliability, and scalability. What You’ll Do Develop and scale retrieval infrastructure, including indexing, serving, and query execution. Build low-latency, high-throughput systems for real-time model interactions. Work with research teams to bring embedding and retrieval methods into production. Support dense, sparse, and hybrid retrieval pipelines. Maintain system performance, reliability, and observability at scale. Collaborate with Pretraining, Inference, and Product teams to deliver end-to-end retrieval solutions. Help develop model-system interfaces for agentic workflows. Who We’re Looking For Experience building and scaling distributed systems. Background in developing high-performance, low-latency systems. Hands-on work with indexing and retrieval techniques. Familiarity with hybrid retrieval systems. Comfort working collaboratively across multiple teams.

At Lyft, we are driven by our mission to connect communities and enhance mobility. We focus on fostering an open, inclusive, and diverse culture that empowers our teams. As part of our Mobile Foundations team, you will play a pivotal role in developing robust software solutions that tackle large-scale challenges, ensuring our mobile applications are not only stable but also scalable and efficient.In your role as a Senior Android Engineer, you will be responsible for creating and maintaining the core systems that serve as the backbone for all Lyft mobile engineers. Your contributions will enable teams across the organization to deliver exceptional experiences that seamlessly connect people and places. You will be instrumental in building scalable infrastructure that accelerates innovation while prioritizing an outstanding developer experience. Your efforts will directly enhance the stability of Lyft as a whole.Our mobile applications are utilized by millions, and we take pride in maintaining high development standards. We follow best practices in code architecture and embrace rapid release cycles. Our codebase is primarily written in Kotlin, leveraging modern design patterns and coding practices. We also actively engage with the developer community, contributing to open-source projects, including the Kotlin language itself.

Join Patreon as a Senior Software Engineer in the Product Foundations team, where you will play a vital role in shaping the future of our platform. You will work collaboratively with cross-functional teams to design, build, and optimize scalable systems that enhance user experience and drive engagement.In this role, you will leverage your expertise in software development to implement innovative solutions, troubleshoot and resolve complex issues, and contribute to the overall success of our product initiatives.