About the job
Join Mindrift as a Freelance Python Data Scraping Engineer on our innovative Tendem project, where you'll play a pivotal role in developing specialized data scraping workflows that integrate both AI and human intelligence.
As an AI Pilot, you'll work closely with Tendem Agents who manage repetitive tasks, while you apply your critical thinking and domain expertise to ensure the accuracy and quality of the data we deliver. This part-time remote opportunity is tailored for professionals with hands-on experience in web scraping, data extraction, and processing.
About Mindrift
At Mindrift, we bridge the gap between human expertise and AI technology. Our platform connects skilled specialists with cutting-edge AI projects from leading tech innovators, empowering them to unlock the potential of Generative AI through real-world insights.
Role Overview
As a Python Data Scraping Engineer, you will manage complex data scraping tasks that demand technical precision for web extraction and processing. You'll utilize tools like Apify and OpenRouter, as well as your own innovative methods, to achieve outstanding results.
Key Responsibilities
- Lead end-to-end data extraction workflows across intricate websites, guaranteeing comprehensive coverage, accuracy, and reliable delivery of structured datasets.
- Utilize internal tools (Apify, OpenRouter) along with your custom workflows to expedite data collection, validation, and task execution while adhering to defined requirements.
- Ensure consistent extraction from dynamic and interactive web sources, adapting your strategies to effectively handle JavaScript-rendered content and evolving website behaviors.
- Uphold data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Compensation
Earn up to $32 per hour based on your experience and contribution pace. Compensation may vary across projects depending on scope, complexity, and required expertise.
How to Apply
Interested candidates can apply immediately to qualify for projects that align with your technical skills, working on your own schedule. From coding and automation to refining AI outputs, you will play a vital role in advancing AI capabilities and their real-world applications.
