About the job
Please submit your CV in English and indicate your level of English proficiency.
At Mindrift, we specialize in connecting talented individuals with project-based AI opportunities at leading tech companies, focusing on the testing, evaluation, and enhancement of AI systems. This is a project-based opportunity, not a permanent position.
About This Role
As a Senior Software Engineer in Test, you will tackle the challenge of creating complex coding test cases designed to push AI coding systems to their utmost limits:
- Review and enhance realistic coding tasks derived from provided production codebases, ensuring they reflect genuine scope, requirements, and information sources.
- Develop comprehensive functional tests that validate true end-to-end behavior and edge cases, rather than just superficial checks.
- Design “fair yet challenging” problems where the AI must gather context from scattered information across files and external sources, necessitating complex reasoning.
- Analyze AI failures to identify model weaknesses and strengths.
- Iterate on your work based on feedback from expert QA reviewers who evaluate your contributions against seven quality criteria.
Qualifications
This opportunity is ideal for seasoned developers, software engineers, and test automation specialists interested in part-time, non-permanent projects. Preferred qualifications include:
- A degree in Computer Science, Software Engineering, or a related field.
- 5+ years of experience in software development, primarily using Python (pytest, async/await, subprocess, file operations).
- Strong background in Full-Stack development, with balanced expertise in creating React-based interfaces and robust back-end systems.
- Proficiency in writing tests (functional, integration – beyond merely executing them).
- Experience working with Docker containers (running evaluations locally in containers).
- Understanding of CI/CD processes (familiarity with GitHub Actions as a user: triggers, labels, reading results).
- English proficiency at a B2 level or higher.
Work Process
Application → Qualification Pass → Project Onboarding → Task Completion → Payment
Estimated Effort
The estimated time to complete tasks for this project is approximately 20 hours, contingent on complexity. This is an estimate, not a fixed schedule; you will have the flexibility to determine when and how you work. Tasks must be submitted by the deadline and meet the specified acceptance criteria to be considered acceptable.
Compensation
Contributors can earn up to $17 per hour, depending on their expertise and contribution pace. Compensation varies by project based on scope, complexity, and required skills. Please note that different projects on the platform may offer varying earning levels based on their criteria.

