About the job
Join Mindrift as a Freelance Python Data Scraping Engineer and contribute to the Tendem project, enhancing our hybrid AI + human data scraping workflows.
In this unique position, referred to as an AI Pilot at Mindrift, you will collaborate with Tendem Agents who manage repetitive tasks. Your role will involve applying critical thinking, domain expertise, and quality control to ensure the delivery of precise and actionable outcomes.
This part-time remote opportunity is perfect for technical professionals with substantial experience in web scraping, data extraction, and processing.
About Us
Mindrift connects specialists with AI projects from leading technology innovators. Our mission is to harness the power of Generative AI by leveraging real-world expertise from around the globe.
Your Role
As a Python Data Scraping Engineer, you will take charge of data scraping tasks that require technical accuracy for web extraction and processing. Utilize a range of tools, including Apify and OpenRouter, as well as your innovative methods.
Key Responsibilities
- Oversee end-to-end data extraction workflows from complex websites, ensuring comprehensive coverage, accuracy, and reliable delivery of structured datasets.
- Utilize internal tools (Apify, OpenRouter) and custom workflows to expedite data collection, validation, and task execution while fulfilling defined requirements.
- Ensure dependable extraction from dynamic and interactive web sources, adjusting strategies as necessary to accommodate JavaScript-rendered content and evolving site behavior.
- Uphold data quality standards through validation checks, consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
- Scale scraping operations for extensive datasets by employing efficient batching or parallelization techniques, monitoring failures, and maintaining stability against minor site structure changes.
Compensation
Contributors can earn up to $32 per hour, depending on their expertise and contribution pace. Note that compensation may vary across projects based on scope and complexity.
How to Apply
Simply apply to this post, qualify, and get the opportunity to work on projects that align with your technical skills, on your own schedule. From coding and automation to refining AI outputs, you will play a vital role in advancing AI capabilities and real-world applications.
Requirements
- Minimum of 3 years of relevant experience in data engineering, web scraping, automation, or related fields.
