About the job
Why Join Nebius?
At Nebius, we are at the forefront of revolutionizing cloud computing to empower the global AI economy. We provide innovative tools and resources that enable our clients to tackle real-world challenges and transform industries without incurring hefty infrastructure costs or needing extensive in-house AI/ML teams. Our workforce operates on the cutting edge of AI cloud infrastructure, collaborating with some of the most experienced and visionary leaders and engineers in the industry.
Our Work Environment
Based in Amsterdam and publicly listed on Nasdaq, Nebius boasts a global presence with R&D centers throughout Europe, North America, and Israel. Our team exceeds 1,400 talented professionals, including over 400 highly skilled engineers proficient in both hardware and software engineering, complemented by an in-house AI R&D division.
The Role
In an ever-evolving landscape, trust in AI hinges on AI agents being grounded in current, verified real-world data. Search is the cornerstone that enables this reliability. In this pivotal role, you will establish the standards for quality within a search system designed specifically for AI agents from the outset.
Your Responsibilities
- Manage end-to-end search-related quality metrics: from their definition and computation to the evolution and transition to next-generation metrics.
- Design and conceptualize analytics architecture across the entire stack: runtime behavior → data pipelines → metrics → dashboards.
- Develop and sustain analytics pipelines and tools using Python.
- Convert product, user, and technical requirements into impactful, actionable metrics.
- Question existing quality assumptions and advocate for enhanced, more reliable measurements.
- Collaborate with product managers, engineers, and stakeholders to ensure analytics align with system behavior and business objectives.
- Diagnose metric anomalies, investigate quality regressions, and recommend data-driven improvements.
