Staff Software Engineer, Inference
AnthropicLondon, UK
On-site Full-time
Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.
Qualifications
The ideal candidate will possess substantial software engineering experience, particularly in distributed systems. You should be results-driven, adaptable, and willing to extend your contributions beyond traditional job boundaries. While familiarity with performance optimization, large-scale service orchestration, and intelligent request routing is essential, knowledge of LLM inference optimization, batching strategies, and multi-accelerator deployments is highly valued. Proficiency in Python or Rust, as well as experience with Kubernetes and cloud infrastructures such as AWS or GCP, will set you apart.
Join Anthropic as a Staff Software Engineer on our Inference team, where you will play a pivotal role in building and maintaining the essential systems that power Claude for millions of users globally. This position involves overseeing the complete stack, from intelligent request routing to fleet-wide orchestration across various AI accelerators. You will focus on enhancing compute efficiency to support our rapid user growth while enabling groundbreaking research through high-performance inference infrastructure. As a key player in tackling complex distributed systems challenges, you will help shape the future of AI technology.
About Anthropic
At Anthropic, we are dedicated to creating AI systems that are not only reliable but also interpretable and steerable. Our mission is to ensure that AI remains safe and beneficial for our users and society at large. Our rapidly expanding team comprises passionate researchers, engineers, policy experts, and business leaders collaborating to develop AI solutions that make a positive impact. Join us in our pursuit of building the future of beneficial AI.
Similar jobs
Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.
