About the job
About Braintrust
Braintrust is at the forefront of AI observability, providing an innovative platform that seamlessly connects evaluation and observability within a single workflow. Our technology empowers developers to gain comprehensive insights into AI behavior in production, equipping them with the necessary tools for enhancement.
Leading companies such as Notion, Stripe, Zapier, Vercel, and Ramp utilize Braintrust to benchmark models, assess prompts, and identify regressions, transforming production data into improved AI with every iteration.
Role Overview
We are seeking talented engineers to create open-source libraries that enable customers to observe, comprehend, and optimize AI functionalities within their production applications. These Software Development Kits (SDKs) are pivotal to Braintrust's platform, facilitating evaluation and observability across diverse environments, frameworks, and AI providers.
This position is perfect for engineers who are enthusiastic about enhancing developer experiences, mastering API design, and crafting swift, dependable, and conventionally designed libraries. You will oversee the entire SDK lifecycle, from conceptualization and development to release, documentation, and community engagement. Your contributions will be integrated into a multitude of applications and will help shape the adoption and operationalization of AI across various industries.
Key Responsibilities
- Develop sophisticated, idiomatic, and resilient SDKs that drive Braintrust’s LLM evaluation and AI observability platform.
- Ensure libraries are user-friendly, efficient, and enjoyable to work with, focusing on developer experience and performance.
- Integrate with prominent AI providers, frameworks, and platforms like OpenAI, Anthropic, and Gemini.
- Create tools and automation processes to enhance testing, profiling, and streamline release workflows.
- Collaborate closely with backend, platform, and product teams to deliver a cohesive and refined developer experience.
- Act as a community ambassador: engage with users, understand their challenges, assist in merging their fixes, and demonstrate empathy towards their needs.
