Exa logoExa logo

Software Engineer - Web Crawling

ExaSan Francisco, California
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Experience

Qualifications

Key QualificationsProven experience in designing and scaling web crawlers, or a strong eagerness to learn quickly in this domain. Proficiency in high-performance programming languages such as C++ or Rust. Familiarity with TypeScript, Playwright, modern web design principles, and the Chrome DevTools Protocol (CDP). Adept at optimizing systems to achieve exceptional performance. A passion for tackling the challenges of acquiring high-quality knowledge and an understanding of its importance in today's world.

About the job

At Exa, we are on a mission to create a groundbreaking search engine from the ground up, designed to empower every AI application. Our team develops robust infrastructure to efficiently crawl the web, trains cutting-edge embedding models for indexing, and engineers high-performance vector databases in Rust for seamless searching. We also manage a state-of-the-art $5M H200 GPU cluster that powers tens of thousands of machines.

As a Software Engineer specializing in Web Crawling, you will take on the exciting challenge of building a web crawler that operates at a scale comparable to Google, revolutionizing the way we access and utilize information online.

About Exa

Exa is at the forefront of innovation, building a powerful search engine designed to support the next generation of AI applications. We leverage cutting-edge technology and a multi-million dollar GPU infrastructure to reshape how information is accessed and utilized globally.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.