Scale AI logoScale AI logo

Engineering Manager, AgentOps

Scale AISan Francisco, CA; New York, NY
On-site Full-time $216.2K/yr - $270.3K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Manager

Qualifications

Responsibilities: Lead the engineering team and oversee technical project delivery. Collaborate effectively across functions, engaging with both internal stakeholders and external clients. Manage all phases of the product lifecycle, from concept through to production. Develop features comprehensively: back-end architecture, system design, debugging, and testing. Execute experiments swiftly and to a high standard to delight our customers. Shape the culture, values, and processes of a growing engineering organization. Motivate and mentor engineering talent. Drive initiatives that enhance the agent development process.

About the job

At Scale AI, we are on a mission to drive the rapid evolution of artificial intelligence applications. For over eight years, we have been at the forefront of AI data production, empowering groundbreaking innovations across various sectors, including generative AI, defense technologies, and self-driving vehicles. Following our recent Series F funding round, we are committed to enhancing the availability of frontier data to support the journey towards Artificial General Intelligence (AGI). We are expanding our capabilities through collaboration with enterprise clients and governmental bodies, enriching our service offerings for both public and private evaluations.

 

About Our Data Engine

 

Our Generative AI Data Engine is the backbone of the world’s leading LLMs and generative models, enabling cutting-edge reinforcement learning with human feedback (RLHF), data generation, model evaluation, and safety compliance. The work we do is critical to shaping how humanity interacts with AI.

 

Join Our AgentOps Team

Our vision for the AgentOps team is to create the premier Agent Development Platform in the AI sector. As agent development is still in its early stages within a fast-evolving landscape, we recognize the need for robust tools that help developers effectively manage agent lifecycles. With direct insight into enterprise customer requirements, our goal is to build a structured yet adaptable platform for all Agent operations, including agent construction, deployment, monitoring, evaluation, and enhancement, all tailored to meet customer needs.

As the industry shifts towards RL workflows requiring verifiable rewards, we aim to enhance this platform to facilitate knowledge capture, creating a compounding effect that boosts agent performance and efficacy. Our goal is to establish a self-sustaining data flywheel that leads to continuous improvements in agent performance and increased customer satisfaction over time.

We are a rapidly expanding team with ambitious objectives and seek driven individuals to join us in making a significant impact in this pioneering domain.

About Scale AI

Scale AI is a leading force in the AI data industry, dedicated to accelerating the development of artificial intelligence applications. Through innovative data solutions, we support a wide range of advancements in technology, particularly in generative AI and autonomous systems. Our commitment to excellence has made us a trusted partner for enterprises and governments alike.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.