Databricks logoDatabricks logo

Senior Software Engineer - Infrastructure and Tools

DatabricksSan Francisco, California
On-site Full-time $166K/yr - $225K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Senior

Qualifications

Qualifications: Proven experience in software engineering, particularly in working with large-scale systems. Strong proficiency in programming languages such as Java, Scala, or Python. Experience with cloud platforms (AWS, Azure, GCP). Familiarity with Kubernetes and container orchestration. Strong analytical skills and the ability to use data to drive decisions. Excellent communication and collaboration skills.

About the job

P-78

While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered.

At Databricks, we are dedicated to empowering data teams to tackle the world's most challenging problems, from realizing the next mode of transportation to advancing medical breakthroughs. We accomplish this by creating and managing the premier data and AI infrastructure platform, enabling customers to leverage deep data insights for business enhancement. Founded by engineers and with a strong customer focus, we eagerly embrace every opportunity to address technical challenges, from crafting cutting-edge UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. And this is just the beginning.

As a Senior Software Engineer on the Infrastructure teams, you will develop scalable systems that underpin the Databricks platform, positioning it as the go-to solution for executing Big Data and AI workloads. Your role will involve enhancing the Databricks infrastructure platform, encompassing multi-cloud systems and services designed to manage thousands of Kubernetes clusters at scale, storing petabytes of data, providing highly scalable and distributed API gateways, implementing a rate limiting framework, ensuring network security and encryption, and creating developer tools and infrastructure (we utilize Bazel), testing frameworks, and scalable CI/CD systems, among many other responsibilities.

The impact you will have:

  • Expand and enhance key components of the core Databricks infrastructure.
  • Design multi-cloud systems and abstractions to enable the Databricks product to operate across existing Cloud providers.
  • Enhance software development workflows to improve engineering and operational efficiency.
  • Utilize our own data and AI platform to analyze build and test logs and metrics, identifying areas for enhancement.
  • Create automated build, test, and release infrastructures.
  • Establish and maintain engineering process standards to support our growth and success.

About Databricks

Databricks is at the forefront of data and AI innovation, providing a robust platform that empowers organizations to harness the power of their data. Our mission is to simplify the complexities of data management and analytics, enabling teams to focus on delivering value through insights and innovations. Join us as we redefine the future of data in an increasingly digital world.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.