onhires logoonhires logo

Senior Scraping Infrastructure Engineer

onhiresArgentina
Remote Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Senior

Qualifications

Core Experience: Demonstrated hands-on experience in high-volume web scraping and data extraction with Python. Anti-Blocking Expertise: Extensive, practical knowledge of anti-bot strategies, including IP rotation, proxy management, and advanced scraping techniques.

About the job

Join a dynamic, remote-first scale-up based in Berlin that specializes in delivering innovative market intelligence and software solutions tailored for the automotive industry. Our client is on the cusp of significant growth, and they are eager to welcome an accomplished Senior Scraping Infrastructure Engineer to bolster their high-impact international team.

If you possess a passion for designing and maintaining robust, large-scale scraping systems that adeptly navigate sophisticated anti-bot and blocking mechanisms, this opportunity is for you. You will oversee the complete lifecycle of high-volume scraping pipelines, concentrating on the infrastructure, tools, and strategic defenses that ensure efficient, accurate, and rapid data collection at scale.

Key Responsibilities

  • Infrastructure Strategy & Architecture: Design, develop, and sustain the foundational infrastructure for extensive asynchronous data extraction systems.

  • Advanced Resilience Engineering: Craft, implement, and continually refine advanced anti-blocking strategies, including IP rotation, fingerprint management, and bot mitigation techniques to assure unwavering reliability and uptime against modern web blocks.

  • Operational Excellence & Monitoring: Establish robust monitoring, alerting, and logging systems to proactively debug, troubleshoot, and consistently enhance scraper performance, reliability, and data quality across the platform.

  • Core Development: Create, test, and deploy resilient and fault-tolerant web scraping components utilizing advanced Python frameworks (Scrapy, Playwright, Selenium, Requests, etc.).

  • Integration & Pipelines: Oversee and automate high-volume data ingestion pipelines, ensuring seamless integration with both internal and external REST APIs.

  • DevOps & Automation: Champion DevOps best practices, including managing infrastructure with Docker, and knowledge of Nomad is a plus, while driving CI/CD pipelines.

  • Collaboration & Mentorship: Collaborate with fellow engineers to set standards, elevate core infrastructure tools, and guide junior members of the team.

Qualifications

  • Core Experience: Demonstrated hands-on experience in high-volume web scraping and data extraction with Python.

  • Anti-Blocking Expertise: Extensive, practical knowledge of anti-bot strategies, including IP rotation, proxy management, and advanced scraping techniques.

About onhires

Our client, a Berlin-based scale-up, operates remotely and provides innovative market intelligence and software solutions tailored for the automotive sector. They are experiencing exciting growth and are looking for talented individuals to join their high-impact team.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.