About the job
We encourage you to submit your CV in English and specify your English proficiency level.
Mindrift connects top-tier specialists with exciting project-based AI opportunities for prestigious tech companies, focusing on the evaluation, testing, and enhancement of AI systems. Please note that participation is project-based and does not constitute permanent employment.
What You'll Be Doing:
Your role will involve developing sophisticated coding test scenarios that challenge AI coding systems:
- Assess and enhance realistic coding tasks derived from existing production codebases, ensuring they align with actual project requirements and information sources.
- Compose detailed functional tests that verify genuine end-to-end behaviors and edge cases, moving beyond basic checks.
- Design “fair yet demanding” challenges that provide the AI with necessary context while requiring it to navigate complex reasoning across dispersed files and external data.
- Investigate AI shortcomings to distinguish between its weaknesses and strengths.
- Refine your work based on evaluations from expert QA reviewers who assess your contributions across seven quality criteria.
What We Seek:
This opportunity is ideal for seasoned developers, software engineers, and test automation specialists interested in part-time, non-permanent engagements. Preferred candidates will possess:
- A degree in Computer Science, Software Engineering, or a related discipline.
- 5+ years of software development experience, predominantly in Python (pytest, async/await, subprocess, file operations).
- A solid background in Full-Stack development, with balanced expertise in crafting React-based interfaces and resilient back-end systems.
- Experience in writing tests (functional, integration—beyond merely executing them).
- Familiarity with Docker containers (for local evaluations within containers).
- Understanding of CI/CD processes (particularly GitHub Actions: triggers, labels, interpreting results).
- English proficiency at the B2 level or higher.
How It Works:
Application → Qualification Assessment → Project Assignment → Task Completion → Compensation
Effort Estimate:
Tasks for this project are expected to require around 20 hours to complete, contingent on complexity. This is a guideline, not a scheduling mandate; you have the flexibility to choose your working hours. All tasks must be submitted by the deadline and fulfill the specified acceptance criteria for approval.
Compensation:
- Paid contributions at rates up to $50/hour*.
- Compensation may be fixed per project or vary based on individual project specifications.
- Some projects may offer additional incentive payments.
*Note: Compensation rates are influenced by expertise, skills assessment, location, project requirements, and other factors. Higher rates may be available for highly specialized experts, while lower rates may apply during onboarding or non-core project phases. Payment details will be disclosed per project.

