About the job
Your Role
At Doctolib, we are dedicated to revolutionizing healthcare delivery through the innovative use of AI technologies.
As a Senior/Staff Machine Learning Engineer, you will be pivotal in crafting, deploying, and enhancing the evaluation framework that guarantees our AI Health Companion operates safely, reliably, and supportively for millions of users, including both patients and healthcare professionals.
Joining a dynamic, cross-disciplinary team of Machine Learning Engineers, Product Engineers, and Medical Experts, you will develop strong evaluation pipelines for agentic AI systems, models adept at reasoning, planning, and navigating intricate healthcare data.
Your key responsibilities will encompass:
- Establishing and owning the evaluation strategy for our AI systems, including metrics, protocols, datasets, and tools.
- Creating and overseeing automated evaluation pipelines to track model quality, safety, and alignment through various iterations.
- Conducting systematic experiments to evaluate reasoning, factual accuracy, robustness, and overall user experience.
- Collaborating closely with model developers and research scientists to provide insights and foster continual improvement.
- Contributing to research and internal knowledge sharing regarding LLM evaluation methodologies and best practices.
Our Technological Landscape
- We operate on a fully cloud-native platform that integrates web and mobile app interfaces, supports multiple languages, and is tailored to meet the specific requirements of various healthcare specialties. Our approach involves modularizing our platform to function within a distributed architecture through reusable components.
- Our technology stack includes Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
- We prioritize ethical AI applications across our products to empower both patients and healthcare professionals. Explore our AI vision here!
