Software Engineer for Data Platform at middesk | San Francisco

Join Hilbert, a pioneering scalable data science platform driving growth for B2C teams with predictive insights into user behavior and revenue sources. Our innovative technology condenses decision-making timelines from months to mere minutes.Trusted by Fortune 10 companies and cherished brands like FreshDirect, Blank Street, and Levain Bakery, Hilbert empowe…

Join Discord, a platform that connects over 200 million users monthly, primarily through gaming. With over 90% of our users engaging in gaming activities, they spend a staggering 1.5 billion hours playing unique titles every month. Discord is pivotal in shaping the future of gaming, enabling seamless interactions before, during, and after gameplay.Every day, countless gamers gather on Discord to strategize, celebrate victories, and foster communities around their favorite games. Behind our voice channels and streaming sessions lies vast amounts of data, capturing the essence of gaming connections.We are in search of an enthusiastic Software Engineer eager to construct data infrastructure at an enormous scale, with a genuine passion for supporting gaming communities. You will play a crucial role in developing the next-generation Data Platform that drives insightful decisions on one of the most vibrant platforms globally.If you are a Software Engineer who thrives on discussing distributed systems, prioritizes user privacy, and seeks to make data-driven decisions that impact millions of gamers worldwide, we would love to hear from you.For more insights into Discord's Data Platform, check out our engineering blog, including how we built our modern data stack leveraging open-source tools!

About UsAt Sierra, we are pioneering a transformative platform designed to empower businesses to cultivate enhanced, more human-centric customer experiences through the power of AI. Headquartered in San Francisco, we proudly maintain a collaborative in-person culture, with expanding offices in Atlanta, New York, London, France, Singapore, and Japan.Our operations are rooted in a set of core values that shape our culture and guide our actions: Trust, Customer Obsession, Craftsmanship, Intensity, and Family. These principles form the bedrock of our endeavors, and we are unwavering in our commitment to embody them in every aspect of our work.Our co-founders, Bret Taylor and Clay Bavor, bring a wealth of experience to Sierra. Bret, who serves as Board Chair of OpenAI, has previously held leadership roles as co-CEO of Salesforce and CTO of Facebook, while Clay boasts an 18-year tenure at Google, where he led innovative projects including Google Lens and Project Starline.Your RoleAs a key member of our dynamic full-stack data team, you will play a pivotal role in enhancing the intelligence of our AI agents with each interaction. You will be instrumental in developing real-time data pipelines, analytics tools, and deep personalization frameworks that convert millions of conversations into actionable business insights. Your responsibilities will encompass:Data Foundations: Design and construct our foundational platform capable of efficiently managing data at scale with minimal latency. This includes developing our real-time eventing infrastructure, streaming and batch ETL pipelines, and an Iceberg-based data lakehouse. You will take ownership of interactive OLAP querying systems, orchestration processes, and experimentation frameworks, ensuring our data remains reliable, rapid, and user-friendly across the organization.Memory & Personalization: Drive the evolution of intelligent experiences by building systems for long-term agent memory, crafting reusable Customer Data Platform (CDP) components, and implementing optimization loops that enable our agents to tailor interactions, significantly enhancing business outcomes.What We’re Looking ForWe are eager to connect with candidates who possess substantial expertise in one or more of the following areas:Platform EngineeringDemonstrated experience in designing and developing scalable data architectures.

Join our team as a Senior Software Engineer focused on our Data Platform at Gusto. In this role, you will leverage your expertise in designing and building scalable data systems that drive business decisions and enhance our platform's capabilities. Your contributions will directly impact our ability to deliver exceptional services to our customers.You will collaborate with cross-functional teams, ensuring that our data architecture is robust, efficient, and aligned with our business goals. If you are passionate about data engineering and are looking for a place to innovate and grow, we want to hear from you!

Jordan Park Group is a premier investment management firm dedicated to providing tailored financial advice to a unique clientele of individuals, families, and institutions. Our clients are distinguished leaders in business, philanthropy, government, and society. Our diverse team embodies empathy and expertise, tackling complexity and challenges to empower clients in achieving their financial aspirations.Our mission is to enhance lives and legacies through strategic financial management.Associate Software Engineer - Data PlatformSan Francisco, CaliforniaYour OpportunityWe are looking for a motivated Technology & Data Engineering Associate to elevate our data platform and enhance data quality initiatives. This role sits at the dynamic intersection of data engineering, analytics, data quality management, and AI integration.The Associate will be responsible for designing, building, and maintaining production-grade data systems, collaborating closely with executives, investment teams, operations, and client services to achieve significant business outcomes. This is a hands-on technical position that offers substantial ownership and visibility within the organization.Your RoleData PlatformDesign, build, and maintain robust SQL data pipelines (e.g., dbt + Snowflake + Python)Develop and manage orchestration workflows (Airflow or equivalent)Create data ingestion processes and API integrationsMonitor pipeline reliability and performance; proactively resolve issuesData Quality & ControlsDevelop deep expertise in the firm’s data, systems, and processesDesign reconciliation frameworks across systems and automate data validation and exception reportingPerform detailed variance analysis and root cause investigationsCollaborate with operations and finance teams to ensure reporting accuracyAnalytics & Business IntelligenceArchitect and maintain Tableau dashboards utilized across the firmTrain and support internal stakeholders on self-service analyticsPython Development & AutomationDevelop Python-based tools for API integrations, data transformations, and ad-hoc analysis

In an era where software is increasingly integrated with artificial intelligence, Scale AI stands at the forefront of this transformation. Our mission is to revolutionize how individuals interact with AI, enhancing human capabilities and redefining productivity. Our groundbreaking products, including the Generative AI Data Engine and SGP, empower leading enterprises and organizations to harness the power of AI through large language models (LLMs) at an unprecedented scale.As part of our innovative Platform Engineering team, you will play a pivotal role in designing and developing robust data storage, streaming, caching, and indexing systems that are essential for our AI solutions. This position offers a unique opportunity to engage with cutting-edge technologies and contribute to the evolution of AI in various sectors, including enterprise, government, and technology.

Who We AreBaton is Ryder’s innovative product development division dedicated to leveraging cutting-edge technologies to transform the transportation and logistics landscape. Managing over $10 billion in freight, our technology has a significant impact across the U.S. economy.We are committed to creating and delivering software that not only meets but exceeds the needs of Ryder and its 50,000+ clients, which includes some of the most recognized brands globally. Our projects range from user-centric applications to the robust data platform that will drive the future of Ryder’s innovations.Baton’s mission: To enable a supply chain that operates on autopilot.Since Ryder’s acquisition of Baton in 2022, we have been operating with the agility of a startup while benefiting from the extensive reach of a Fortune 500 company. If you're passionate about tackling intricate challenges and making a real impact in the backbone of the American economy, you’ll thrive with us.Role: Software Engineer - InfrastructureDepartment: Data PlatformLocation: Hayes Valley, San Francisco, CA

About the Role Anthropic is hiring a Software Engineer to support our Research Data Platform. This position is based in San Francisco, CA or New York City, NY. The team works closely with engineers and researchers to create data solutions that strengthen our research efforts. The work directly supports Anthropic’s mission to develop safe and beneficial AI.

Role overview Chime seeks a Senior Software Engineer for the Data Platform team based in San Francisco, CA. This position centers on building and enhancing the systems behind Chime’s data infrastructure. The work directly supports Chime’s goal of helping members achieve financial peace of mind. What you will do Design, build, and maintain scalable data pipelines that form the backbone of Chime’s data operations Collaborate with colleagues across engineering, product, and analytics to deliver reliable data solutions Help ensure data integrity and strong system performance as Chime’s user base and data needs expand

About Us:At Parafin, our mission is to empower small businesses, the backbone of our economy. Traditional banks often overlook their needs, but we provide technology that simplifies access to essential financial tools directly through the platforms they already use for sales. We collaborate with industry leaders such as DoorDash, Amazon, Worldpay, and Mindbody to deliver fast and flexible funding, spend management, and savings tools seamlessly integrated into their services. By handling the complexities of capital markets, underwriting, servicing, compliance, and customer support for our partners, we enable small businesses to thrive.Our team is composed of innovators from top companies including Stripe, Square, Plaid, Coinbase, and Robinhood. Together, we share a passion for developing tools that drive success for small businesses. Backed by notable venture capitalists like GIC, Notable Capital, Redpoint Ventures, Ribbit Capital, and Thrive Capital, Parafin is a Series C company that has successfully raised over $194 million in equity and $340 million in debt facilities.Join us in creating a future where every small business has access to the financial resources they need to succeed.About the Position:We are seeking an experienced software engineer to join Parafin’s Infrastructure team and take the lead in developing our next-generation Data Platform. This pivotal role ensures that our data infrastructure remains reliable, scalable, and user-friendly, as we continue enhancing financial services for small businesses.As a Senior Software Engineer, your responsibilities will include designing, building, and maintaining systems for data ingestion, transformation, and delivery across the organization. You will closely collaborate with Data Science, Platform Engineering, and Product Engineering teams to facilitate data-driven product development and informed decision-making.What You’ll Do:Design and construct robust, highly scalable data pipelines and lakehouse infrastructure using PySpark, Databricks, and Airflow on AWS.Enhance the data platform development experience for Engineering, Data Science, and Product teams by creating intuitive abstractions, self-service tools, and comprehensive documentation.Manage and uphold core data pipelines and models that support internal dashboards, machine learning models, and customer-facing products.Oversee the Data & ML platform infrastructure via Terraform, including full administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high reliability.

About Discord Discord connects over 200 million people every month, with gaming at the heart of the platform. More than 90% of users participate in gaming activities, spending a combined 1.5 billion hours each month across thousands of games. The team is focused on improving how gamers communicate and share experiences before, during, and after play. Role Overview Discord is hiring a Senior Staff Software Engineer to help build and evolve large-scale data infrastructure. This work supports critical decision-making and directly shapes the experience for millions of gamers worldwide. The Data Platform team is responsible for systems that empower teams across the company and influence technical direction at a broad level. This position is based in San Francisco, CA. What You'll Do Design and develop the next generation of Discord's Data Platform Build systems that improve team productivity and reliability Influence technical strategy across the organization Work on projects that impact millions of global users Navigate ambiguity and solve complex technical challenges Learn More For a deeper look at Discord's Data Platform, visit the engineering blog, including details on how Discord uses open-source tools for scalable data orchestration and transformation.

Join Our Mission as a Staff Software EngineerAs a pivotal member of our Data Engineering team at Prosper, we are seeking a talented Enterprise Python Expert. Your primary responsibility will be to enhance our data ecosystem by designing and implementing high-quality software solutions. You will focus on building robust data pipelines and services while optimizing system architecture and ensuring clean, scalable code development within our Google Cloud Platform (GCP) environment.

Discord connects over 200 million users each month for various activities, with a significant focus on gaming. Over 90% of our community engages in gaming, collectively spending 1.5 billion hours playing thousands of unique titles on our platform monthly. As we look toward the future, Discord aims to enhance the gaming experience by facilitating seamless communication and social interaction before, during, and after gameplay.We are in search of a highly skilled Senior Software Engineer to join our innovative team. In this pivotal role, you will design, develop, and maintain our data infrastructure and services. You will collaborate with cross-functional teams including data engineers, data scientists, software engineers, and product managers to implement cutting-edge solutions that promote business insights and innovation. This position reports directly to the Director of Engineering, Data Platform.To explore more about Discord’s Data Platform, check out our engineering blog — including how we built our modern data stack leveraging open-source tools!

Dagster Labs develops tools that enable organizations to build scalable and efficient data platforms. The company’s core offerings include Dagster, an open-source project popular among developers, and Dagster+, a managed cloud solution. These products support thousands of teams, ranging from early-stage startups to established enterprises, in their analytics, machine learning, and AI initiatives. With the rapid growth of AI, the need for reliable, high-quality data has never been greater. Dagster Labs is dedicated to simplifying the testing, comprehension, and usability of data platforms. Many top AI companies have adopted Dagster as a foundational part of their technology stack. Team culture The team operates with strong funding and a collaborative spirit. High standards, open communication, and a focus on trust and curiosity shape the work environment. The company values a workplace free from egos and unnecessary drama. Locations This is a remote-first company with offices in San Francisco, New York, and Minneapolis.

Are you ready to push the boundaries of your capabilities?At Coinbase, our vision is to enhance economic freedom globally. This ambitious endeavor requires our utmost dedication as we develop the future on-chain platform and, consequently, the global financial system of tomorrow.We are in search of a unique individual who shares our passion for this mission and recognizes the transformative potential of cryptocurrency and blockchain technology in revolutionizing finance. We seek someone who is driven to make a significant impact, thrives under pressure, and values constructive feedback for continuous improvement. If you are eager to confront complex challenges head-on, we want you on our team.Our work culture is rigorous and may not suit everyone. However, if you aspire to shape the future alongside exceptional colleagues who demand excellence, look no further.While many positions at Coinbase allow for remote work, we are not exclusively remote. In-person participation is encouraged throughout the year, with multiple team and company-wide offsite events designed to foster collaboration and alignment. Attendance is both expected and fully supported.At Coinbase, our quest for economic freedom necessitates not only outstanding products but also a robust data foundation. The Data Platform team serves as the backbone of Coinbase’s data infrastructure, ensuring reliability, speed, and accessibility at scale. This critical support enables everything from fraud detection and financial reporting to the advanced AI and ML systems that will define Coinbase's future.The RoleWe are seeking a visionary and hands-on Senior Staff Software Engineer to define and steer the technical strategy for Coinbase’s Data Platform. This pivotal role sits at the intersection of distributed systems, data engineering, and AI preparedness, offering a rare opportunity to build significant infrastructure within one of the most influential companies in the crypto space.Reporting to the Senior Director of Engineering for Data Platform, you will take on the role of the domain's foremost technical leader. You will set the architectural vision, mentor emerging engineering talent, drive multi-quarter roadmaps, and play a crucial role in transitioning Coinbase from a collection of managed data services into a scalable, cohesive data platform. This position provides considerable autonomy and is expected to have a far-reaching impact across various cross-functional teams and the broader Infrastructure organization.

Why join Brex?At Brex, we are revolutionizing financial management with our AI-driven spend platform, designed to empower companies of all sizes — from innovative startups to established enterprises like DoorDash and Compass. Our integrated services, including corporate cards, banking, and global payments, along with intuitive travel and expense software, help organizations manage their spending confidently, reduce costs, and enhance operational efficiency globally.Joining our team means embracing challenges, pushing boundaries, and collaborating with some of the brightest minds in the tech industry. We are dedicated to fostering a diverse and inclusive workplace, where your potential is only limited by your ambition. Our commitment is reflected in the tools, resources, and support we provide for your professional growth.Engineering Excellence at BrexOur engineering teams are focused on creating scalable systems with precision and speed. We operate with a high degree of autonomy and collaborative spirit, tackling complex technical challenges and driving excellence from architecture to deployment. Here, engineering is not just a job — it’s a craft, and our builders are empowered to become leaders.Work EnvironmentThis position is based in our San Francisco office, where we foster a hybrid work culture that balances the vibrant energy of in-person collaboration with the flexibility of remote work. Currently, we require team members to be in the office for at least three coordinated days each week: Monday, Wednesday, and Thursday. Additionally, we offer the opportunity for up to four weeks of fully remote work each year!Your RoleAs a Senior Software Engineer on our Product Data Platform (PDP) team, you will play a crucial role in developing and maintaining the high-performance data, query, and search infrastructure that underpins essential product experiences at Brex. Your mission will be to create systems that are customizable, scalable, and reliable for finance teams, requiring the development of optimized, production-grade backend solutions.In this role, you'll focus on data-intensive, distributed systems at scale, leading architectural and performance enhancements across the platform to improve latency, correctness, and scalability across various product surfaces. You’ll also contribute to AI-powered data products, including a dynamic reporting experience that allows customers to interact intelligently with their financial data. Your contributions will ensure that these systems remain fast, reliable, and designed for growth.

Join Airwallex as a Senior Software EngineerAt Airwallex, we are redefining the global payments and financial landscape for businesses. Our integrated financial platform empowers over 200,000 companies, including major players like Brex and SHEIN, to streamline their operations from payment processing to treasury management.Founded in Melbourne, we now boast a diverse team of over 2,000 talented professionals across 26 offices globally. With a valuation of $8 billion and backing from top-tier investors such as T. Rowe Price and Visa, we are on a mission to revolutionize the future of global banking and finance. If you are ready to take on ambitious challenges and make a significant impact, we want you on our team.What We Look ForWe seek passionate builders who thrive in a fast-paced environment and are driven by innovation. If you possess deep technical expertise, exceptional problem-solving skills, and a collaborative spirit, you will excel here. We value curiosity, humility, and the ability to turn visionary ideas into tangible products. Leverage AI to enhance efficiency and tackle complex challenges with strong teammates as we shape the future of finance together.Your RoleAs a Senior Software Engineer within our Platform Engineering team, you will play a crucial role in designing and implementing next-generation infrastructure. We are focused on developing a robust, distributed ecosystem that supports real-time AI capabilities and global financial data management.Your responsibilities will include optimizing distributed systems, enhancing JVM performance, and employing architectural patterns that facilitate real-time data processing.

Waymo is a pioneering company in autonomous driving technology, dedicated to becoming the world’s most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has established the Waymo Driver—The World’s Most Experienced Driver™—with a mission to enhance mobility access and save lives lost in traffic accidents. The Waymo Driver powers our fully autonomous ride-hailing service and can be integrated across various vehicle platforms and applications. Having completed over ten million rider-only trips, our technology has driven more than 100 million miles on public roads and tens of billions in simulations across over 15 U.S. states.The Perception team is responsible for developing systems that learn the spatial-temporal representations and semantic meanings of the environment surrounding our autonomous vehicles (AVs). We collaborate closely with downstream teams to optimize and integrate our work into the Waymo Driver, conduct research to solve real-world challenges, and work alongside research teams at Alphabet. With access to millions of miles of diverse driving data from various sensors, we empower engineers like you to (1) create methods for efficient continuous learning from extensive real-world data, (2) develop scalable models and training methodologies, (3) analyze real-world behaviors to create systems that can navigate complexities, and (4) optimize models for both onboard and offboard hardware.In this hybrid role, you will report to a Technical Lead Manager.

About CondorAt Condor, we are transforming the financial infrastructure of clinical development. While substantial investments are made annually to discover and develop new therapies, the processes behind these advancements often remain outdated and disconnected. Our mission is to bridge this gap, creating a cohesive system that integrates clinical operations, vendor activities, and financial data into a real-time intelligence layer. This empowers R&D and finance teams with the insights they need to make informed decisions.Our AI-driven, pharma-native infrastructure is designed to scale industry standards that we have helped shape alongside major partners. We facilitate prediction, control, and execution in some of the most complex R&D environments globally.As we continue to gain the trust of enterprise teams, we are now focused on the critical task of scaling our operations in a high-stakes environment.Condor is a rapidly growing company, backed by leading institutional investors such as Felicis and 645 Ventures, collaborating with top 200 biopharma companies. This is a unique opportunity to contribute to the infrastructure that influences how new therapies reach patients.The RoleWe are seeking a Senior Backend and Data Platform Engineer to play a key role in developing the foundational data infrastructure for Condor’s financial intelligence platform. This position is pivotal in turning complex clinical and financial data into actionable intelligence that enterprise biopharma teams can rely on.In this role, you will be responsible for designing and managing the core data foundations that underpin Condor’s financial engine and AI capabilities. Your work will involve modeling intricate, high-stakes data, constructing reliable data pipelines and services, and ensuring that product features and intelligence workflows function with precision, consistency, and scalability. The systems you develop will directly support critical finance and operational applications.This hands-on, senior engineering position provides you with significant ownership. You will engage with backend services, data pipelines, and APIs, bringing features from concept to production. You will define necessary data schemas, transformations, and architectural patterns that become essential as our platform evolves. Although your primary focus will be on backend and data engineering, you will also be encouraged to work across the stack to ensure seamless integration of data and intelligence.