About the role
Anyscale is looking for a Software Engineer to focus on Model Serving Infrastructure in Bengaluru, Karnataka. The position centers on building and refining the systems that deliver machine learning models at scale. The work involves ensuring these systems are robust, efficient, and ready to support growing demands.
What you will do
- Design and build infrastructure to serve machine learning models with high efficiency and reliability.
- Optimize systems to manage fluctuating workloads and maintain steady performance.
- Collaborate with engineering and product teams to extend the platform’s features.
- Address challenges related to deploying models and maintaining operational reliability.
Collaboration
This role requires frequent interaction with cross-functional groups. Working together, you will help advance the platform and respond to new requirements in AI and machine learning deployment.
