poolside logopoolside logo

Engineering Evaluations Specialist

poolsideRemote (EMEA/East Coast)
Remote Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Experience

Qualifications

SKILLS & EXPERIENCE REQUIREDProven experience with Large Language Models and AI evaluations. Strong collaboration skills, with a focus on effective communication and teamwork. Ability to define and analyze metrics that guide software development efforts.

About the job

About Poolside

Poolside is working toward a future where Artificial General Intelligence becomes a practical reality. The team focuses on applied research, advanced engineering, scalable infrastructure, and broad deployment, all with the goal of making AI a driver for economic and scientific progress.

Read our GDPR Policy.

Team Culture

Poolside operates fully remotely, with team members based across Europe and North America. The group meets in person once a month for three days and holds two longer offsite gatherings each year. Team members bring a range of research and engineering backgrounds, sharing a commitment to strong software development practices and building reliable systems.

Role Overview: Engineering Evaluations Specialist

The Engineering Evaluations Specialist designs and builds infrastructure and tools that support Poolside’s researchers and engineers. This role helps ensure technical progress translates into real improvements for users.

What You Will Do

  • Research and implement evaluation methods and benchmarks for foundational and instruction-following models.
  • Work closely with applied research and product teams to define metrics and evaluations that capture progress in real-world software development skills.
  • Participate in planning, discussions, and communication to help shape future projects and maintain clear alignment with peers.

Location

This is a remote position open to candidates based in EMEA or on the East Coast of North America.

About poolside

poolside is a pioneering company dedicated to realizing the potential of Artificial General Intelligence, driving economic value and scientific advancement through innovative AI solutions.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.