Braintrust logoBraintrust logo

Open Source Engineer - Python at Braintrust | Remote

Remote Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Experience

Qualifications

Ideal Candidate ProfileYou may be a great fit if you:Are driven by customer success and passionate about addressing real-world challenges for developers. Possess extensive expertise in Python and comprehend the intricacies of building fast, idiomatic, and reliable libraries within this ecosystem. Are adept with tools necessary for developing robust SDKs, including testing frameworks, profilers, CI/CD pipelines, and packaging systems. Value developer experience, from clean APIs and clear documentation to thoughtful error handling and back-off strategies.

About the job

About Braintrust

Braintrust is at the forefront of AI observability, providing an innovative platform that seamlessly connects evaluation and observability within a single workflow. Our technology empowers developers to gain comprehensive insights into AI behavior in production, equipping them with the necessary tools for enhancement.

Leading companies such as Notion, Stripe, Zapier, Vercel, and Ramp utilize Braintrust to benchmark models, assess prompts, and identify regressions, transforming production data into improved AI with every iteration.

Role Overview

We are seeking talented engineers to create open-source libraries that enable customers to observe, comprehend, and optimize AI functionalities within their production applications. These Software Development Kits (SDKs) are pivotal to Braintrust's platform, facilitating evaluation and observability across diverse environments, frameworks, and AI providers.

This position is perfect for engineers who are enthusiastic about enhancing developer experiences, mastering API design, and crafting swift, dependable, and conventionally designed libraries. You will oversee the entire SDK lifecycle, from conceptualization and development to release, documentation, and community engagement. Your contributions will be integrated into a multitude of applications and will help shape the adoption and operationalization of AI across various industries.

Key Responsibilities

  • Develop sophisticated, idiomatic, and resilient SDKs that drive Braintrust’s LLM evaluation and AI observability platform.
  • Ensure libraries are user-friendly, efficient, and enjoyable to work with, focusing on developer experience and performance.
  • Integrate with prominent AI providers, frameworks, and platforms like OpenAI, Anthropic, and Gemini.
  • Create tools and automation processes to enhance testing, profiling, and streamline release workflows.
  • Collaborate closely with backend, platform, and product teams to deliver a cohesive and refined developer experience.
  • Act as a community ambassador: engage with users, understand their challenges, assist in merging their fixes, and demonstrate empathy towards their needs.

About Braintrust

Braintrust is a leading AI observability platform, revolutionizing how developers interact with and improve AI performance in production. Our innovative tools are trusted by top-tier companies, enhancing their AI strategies and driving significant improvements in their workflows.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.