About the job
Mindrift is seeking talented Python Data Scraping Engineers to contribute to the Tendem project, enhancing our innovative hybrid AI and human system through specialized data scraping workflows.
In the capacity of an AI Pilot, as we refer to this role at Mindrift, you will work collaboratively with Tendem Agents executing repetitive tasks, while you apply your critical thinking, domain expertise, and quality assurance skills to deliver precise and actionable data.
This part-time remote position is ideally suited for technical experts with substantial experience in web scraping, data extraction, and processing.
About Us
The Mindrift platform bridges specialists with AI projects from leading technology innovators. Our mission is to harness the power of Generative AI by leveraging expertise from specialists around the world.
Role Overview
This freelance role is part of the Tendem project. As a Python Data Scraping Engineer, you will be responsible for executing data scraping tasks with a focus on technical accuracy for web extraction and processing, employing various tools such as Apify and OpenRouter, along with your own innovative methods.
Key Responsibilities
- Manage end-to-end data extraction processes across intricate websites, ensuring thorough coverage, accuracy, and dependable delivery of structured datasets.
- Utilize internal tools (Apify, OpenRouter) along with custom workflows to expedite data collection, validation, and task execution while adhering to defined specifications.
- Guarantee reliable data extraction from dynamic and interactive web sources, modifying strategies as necessary to accommodate JavaScript-rendered content and evolving site behavior.
- Maintain data quality standards through validation checks, cross-source consistency controls, adherence to formatting guidelines, and systematic verification prior to data delivery.
- Enhance scraping operations for large datasets through efficient batching or parallelization, monitor failures, and ensure stability in response to minor changes in site structure.
Compensation
Contributors can earn up to $32 per hour, based on their experience and contribution speed. Note that compensation varies by project depending on its scope, complexity, and required expertise.
How to Apply
To get started, simply apply to this posting, qualify, and you will have the opportunity to work on projects that align with your technical skills, on your own schedule. From coding and automation to refining AI outputs, you will play a pivotal role in advancing AI capabilities and real-world applications.
