About the job
At Roblox, our platform is home to millions of users who engage in exploration, creativity, gaming, learning, and connection through immersive 3D digital experiences crafted by a diverse community of developers and creators.
We are dedicated to empowering our community with innovative tools and platforms that enable them to bring their imaginative ideas to life. Our vision is to transform the way individuals connect globally across devices. Our mission is to unite a billion people through positivity and respect, and we are in search of exceptional talent to help us achieve this goal.
Joining Roblox means you will contribute to defining the future of human interaction, tackle unique technical challenges on a grand scale, and assist in creating safer, more respectful shared experiences for everyone.
WHY DATA SCIENCE & ANALYTICS?
The Data Science & Analytics team aims to enhance our speed, frequency, and insight in decision-making at scale by adopting a data-driven strategy for product development. We span a broad range of data disciplines, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, and machine learning. Collaborating with product teams, we leverage our diverse toolkit to uncover new opportunities, impact product roadmaps, prioritize data products, and assess their effects on our community of players and developers.
WHY GENERATIVE AI?
Our mission is to empower Roblox Creators by integrating GenAI functionalities for millions of users while maintaining a strong commitment to safety, responsibility, and quality.
As a Data Scientist, you will be pivotal in evaluating and optimizing user-facing GenAI systems (including text, image, video, 3D, and 4D). You will establish the metrics for assessing safety, responsibility, quality, and efficiency, employing techniques such as annotation analysis, experimental design, causal inference, model-based evaluations (like LLM-as-a-judge), optimization algorithms, and AI models to guide product decisions and enhance models.
You Will:
- Develop Evaluation Frameworks: Create and implement robust evaluation systems for GenAI features (text, image, video, 3D, 4D) involving experimental design, dataset structuring, label reliability analysis, and more.
