Doctolib logoDoctolib logo

Senior/Staff Machine Learning Engineer - Health Evaluation - AI Teams

DoctolibParis, Paris, France
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Senior

Qualifications

Who You AreIf you feel that your skills align closely with this job description, we encourage you to apply even if you don’t meet every qualification listed. MSc or PhD in Computer Science, Machine Learning, Data Science, or a related discipline. Over 7 years of practical experience with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures). Demonstrable experience in evaluating agentic or reasoning systems (e.g., autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants). A strong background in experimental design, metric definition, and evaluation methodologies.

About the job

Your Role

At Doctolib, we are dedicated to revolutionizing healthcare delivery through the innovative use of AI technologies.

As a Senior/Staff Machine Learning Engineer, you will be pivotal in crafting, deploying, and enhancing the evaluation framework that guarantees our AI Health Companion operates safely, reliably, and supportively for millions of users, including both patients and healthcare professionals.

Joining a dynamic, cross-disciplinary team of Machine Learning Engineers, Product Engineers, and Medical Experts, you will develop strong evaluation pipelines for agentic AI systems, models adept at reasoning, planning, and navigating intricate healthcare data.

Your key responsibilities will encompass:

  • Establishing and owning the evaluation strategy for our AI systems, including metrics, protocols, datasets, and tools.
  • Creating and overseeing automated evaluation pipelines to track model quality, safety, and alignment through various iterations.
  • Conducting systematic experiments to evaluate reasoning, factual accuracy, robustness, and overall user experience.
  • Collaborating closely with model developers and research scientists to provide insights and foster continual improvement.
  • Contributing to research and internal knowledge sharing regarding LLM evaluation methodologies and best practices.

Our Technological Landscape

  • We operate on a fully cloud-native platform that integrates web and mobile app interfaces, supports multiple languages, and is tailored to meet the specific requirements of various healthcare specialties. Our approach involves modularizing our platform to function within a distributed architecture through reusable components.
  • Our technology stack includes Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
  • We prioritize ethical AI applications across our products to empower both patients and healthcare professionals. Explore our AI vision here!

About Doctolib

Doctolib is at the forefront of transforming healthcare through AI technology, aiming to create a seamless experience for patients and healthcare providers alike.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.