About the job
Please submit your CV in English and indicate your level of English proficiency.
At Mindrift, we specialize in connecting talented professionals with project-based AI testing opportunities for some of the leading technology firms. Our focus is on evaluating, testing, and enhancing AI systems. Note that participation is project-based and does not lead to permanent employment.
What You Will Be Doing
You will be responsible for creating complex coding test scenarios that challenge AI coding systems:
- Assess and enhance practical coding tasks using provided production codebases, ensuring they reflect realistic scope and requirements.
- Design comprehensive functional tests that validate the actual end-to-end behavior and edge cases, avoiding mere superficial checks.
- Devise challenging yet equitable scenarios where the AI has the necessary context, but must engage in complex reasoning and information synthesis from multiple sources.
- Investigate AI failures to pinpoint the model's weaknesses and strengths.
- Refine tasks based on feedback from expert QA reviewers who evaluate your work across seven quality metrics.
Who We Are Looking For
This role is ideally suited for seasoned developers, software engineers, or test automation specialists looking for part-time, project-based engagements. The ideal candidates will possess:
- A degree in Computer Science, Software Engineering, or a related field.
- Over 5 years of experience in software development, particularly with Python (pytest, async/await, subprocess, file operations).
- A solid background in Full-Stack development, with equal emphasis on crafting React-based interfaces and robust backend systems.
- Proficiency in writing tests (functional, integration—not just executing them).
- Experience with Docker containers for local evaluation tasks.
- An understanding of CI/CD processes (as a GitHub Actions user, including triggers, labels, and result interpretation).
- English proficiency at a B2 level or higher.
How It Works
Application → Qualification → Project Assignment → Task Completion → Compensation
Effort Estimate
Estimated task completion time is around 20 hours, depending on complexity. This is flexible, allowing you to choose your working hours, provided you meet submission deadlines and acceptance criteria.
Compensation Details
- Earn up to $80/hour* for your contributions.
- Compensation may be based on fixed project rates or individual rates, depending on the project.
- Incentive payments may be included for certain projects.
*Note: Rates may vary based on expertise, skill assessments, geographical location, project needs, and other factors. Higher rates may be available for highly specialized experts, while onboarding or non-core project phases may see lower rates. Payment specifics will be communicated on a per-project basis.

