Freelance Agent Evaluation Engineer

Toloka AIRemote — Rome, Metropolitan City of Rome Capital, Italy

Remote Contract

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.

Experience Level

Entry Level

Qualifications

The ideal candidate should have a strong background in AI evaluation, experience with data analysis, and a keen eye for detail. Familiarity with machine learning algorithms and the ability to work independently in a remote setting are essential. A degree in computer science, engineering, or a related field is preferred.

About the job

We are seeking a talented Freelance Agent Evaluation Engineer to join our innovative team at Toloka AI. In this role, you will be responsible for evaluating and improving the quality of our agents, ensuring they meet our high standards for performance and reliability. This is an exciting opportunity to contribute to the development of our cutting-edge AI solutions.

About Toloka AI

Toloka AI is a leading company in the field of artificial intelligence, dedicated to creating advanced solutions that enhance human-computer interaction. Our commitment to quality and innovation drives us to seek out the best talent to join our dynamic team. We foster a collaborative work environment where creativity and forward-thinking are encouraged.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

1 - 20 of 546 Jobs

Search for AI Engineer

546 results

Select all on this page (20)

Apply

AI Workflow Engineer - Freelance AI Trainer

Mindrift

Contract|$50/hr - $50/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Mindrift brings together specialists and AI projects from leading technology companies, with a focus on practical applications of Generative AI. The team values real-world expertise and works globally to advance AI-driven solutions. Role overview This is a part-time, remote freelance role supporting the Tendem project (https://tendem.ai/). As an AI Workflow …

Apr 24, 2026

Apply

Freelance AI Workflow Engineer at Mindrift | Remote

Mindrift

Part-time|$50/hr - $50/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Join Mindrift as a talented AI Workflow Engineer and become a key contributor to the Tendem project (tendem.ai). In this role, referred to as an AI Pilot, you will collaborate with Tendem Agents to automate repetitive tasks while applying your expertise in structured thinking, prompt engineering, and quality control to create scalable, efficient AI-driven workflows.This part-time, remote position is perfect for professionals with practical experience in integrating Large Language Models (LLMs), designing prompts, and developing AI automation systems.About MindriftAt Mindrift, we connect specialists with innovative AI projects from leading technology companies. Our mission is to harness the power of Generative AI by leveraging real-world expertise from around the globe.Role OverviewAs a Freelance AI Workflow Engineer, you will be responsible for designing, developing, and optimizing workflows that integrate LLM APIs, facilitating content generation, communication, and automation. Your contributions will enhance the reliability and scalability of our AI systems.

May 2, 2026

Apply

Optical Engineer - Freelance AI Trainer

Mindrift

Part-time|$29/hr - $29/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Please submit your CV in English and indicate your English proficiency level. Mindrift offers project-based AI work for specialists, connecting professionals with assignments that focus on testing, evaluating, and improving AI systems. All roles are freelance and do not represent permanent employment. Role overview This freelance Optical Engineer - AI Trainer position centers on designing and documenting complex optics problems for AI training. Work is remote and open to candidates based in Rome or elsewhere in Italy. Each project may differ in scope and requirements. Main responsibilities Develop original optics problems that reflect real-world physics research workflows Create computationally intensive challenges that cannot be solved by hand in a short period Design problems requiring advanced reasoning across mechanics, electromagnetism, thermodynamics, and quantum mechanics Base each challenge on real research questions or practical applications in optics and physics Document all problems clearly and provide accurate, verified solutions Requirements Background as an optical engineer interested in part-time, project-based work Degree in Physics (theoretical, experimental, or computational) or a closely related field Minimum 2 years of experience in applied, research, or teaching roles Experience with numerical simulation methods Ability to design problems that mirror authentic research workflows Creative problem-solving skills across multiple physics domains Familiarity with physics modeling and approximation techniques Strong written English skills at C1 level or higher Application process Apply with a CV and details on English proficiency Complete qualification steps Join a project Work on assigned tasks Receive compensation Project commitment Expect to dedicate 10–20 hours per week during active project phases. Actual hours may change depending on project needs. Compensation Rates can reach up to $29 per hour, depending on expertise and speed. Actual pay may vary by project scope, complexity, and required skills. Other Mindrift projects may offer different compensation based on their requirements.

Apr 24, 2026

Apply

DevOps Engineer - Automation Systems (Freelance AI Trainer)

Mindrift

Part-time|$50/hr - $50/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Mindrift is on the lookout for talented DevOps and Automation Engineers to contribute to the innovative Tendem project (tendem.ai). Your role will be pivotal in creating and managing scalable infrastructure that supports automation workflows in a dynamic hybrid AI and human-centric environment.As an AI Pilot, you will collaborate with Tendem Agents focused on repetitive tasks, while leveraging your infrastructure expertise to optimize system reliability and performance, ensuring robust and scalable automation pipelines.This part-time remote position is perfect for professionals with hands-on experience in cloud infrastructure, system deployment, and high-load automation environments.

May 2, 2026

Apply

Freelance Mechanical Engineer & Python Specialist - AI Project Contributor

Mindrift

Part-time|$31/hr - $31/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

We kindly ask you to submit your CV in English, along with your English proficiency level.Mindrift specializes in connecting talented professionals with project-based AI opportunities at top technology firms, focusing on testing, evaluating, and enhancing AI systems. Please note this is a project-based role and not a permanent position.Role OverviewEach project features distinct tasks, where contributors may be expected to:Design original computational engineering challenges that effectively mimic real-world engineering workflows;Create programming tasks utilizing Python to solve engineering calculations and simulations;Ensure that the challenges are computationally demanding, requiring numerical methods or iterative solutions;Develop problems encompassing system design, optimization, and thorough analysis;Base problems on authentic research challenges or practical applications within the engineering field;Validate solutions using Python, employing standard engineering libraries;Clearly document problem statements and provide verified correct answers.Candidate ProfileThis role is ideal for engineers with Python expertise who are open to part-time, non-permanent projects. Preferred qualifications include:A degree in Mechanical Engineering or a related discipline;Proficiency in Python for numerical validation; knowledge of MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or any domain-specific libraries is also acceptable;At least 2 years of professional experience, which can include applied, research, or teaching roles;A solid understanding of practical engineering constraints and approximations;Excellent written English skills (C1+ level);Professional certifications (e.g., CMME, SAS Certifications, CAP) and experience in international or applied projects are advantageous.Process OverviewTo participate, candidates must apply, pass qualifications, join a project, complete assigned tasks, and receive payment.Project CommitmentTasks for this project are estimated to require approximately 10–20 hours per week during active phases, depending on project requirements. This is an estimate and does not guarantee a fixed workload.CompensationContributors can earn up to $31 per hour, contingent on their expertise and contribution pace. Compensation across projects may vary based on scope, complexity, and required expertise. Note that other opportunities on the platform may present different compensation levels.

May 1, 2026

Apply

Freelance Optical Engineer - AI Training Opportunities

toloka-ai

Part-time|$29/hr - $29/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

We invite you to submit your CV in English along with your proficiency level in the language.At Mindrift, we bridge the gap between skilled professionals and project-based AI opportunities for prominent tech firms, with a focus on testing, evaluating, and enhancing AI systems. This role is project-based, not a permanent position.Opportunity OverviewEach project presents unique tasks, and contributors may be involved in:Creating original optics problems that reflect authentic physics research workflows;Ensuring challenges are computationally demanding, with solutions that cannot be derived manually within a reasonable timeframe (days to weeks);Formulating problems that necessitate complex reasoning across mechanics, electromagnetism, thermodynamics, and quantum mechanics;Grounding problems in real-world research challenges or practical applications within optics and physics;Clearly documenting problem statements and providing verified, accurate solutions.Candidate ProfileThis opportunity is ideal for optical engineers interested in part-time, non-permanent projects. Preferred qualifications include:A degree in Physics (Theoretical, Experimental, or Computational) or related disciplines;A minimum of 2 years of professional experience, including applied, research, or teaching backgrounds;Proficiency in numerical simulation methods;A knack for designing problems that replicate real physics research workflows;Creative problem-solving skills across various physics domains;Familiarity with physics modeling and approximation techniques;Strong written English skills (C1+).Process OverviewApply → Qualify → Join a project → Execute tasks → Receive paymentProject CommitmentTasks are estimated to require approximately 10–20 hours per week during active phases, contingent on project demands. This is an estimate and not a guaranteed workload during the project's active period.CompensationContributors can earn up to $29 per hour, based on their level of expertise and contribution pace. Compensation may vary across projects depending on their scope, complexity, and required skills. Please note that other projects may offer different earning structures based on their specific needs.

May 2, 2026

Apply

Generative AI Engineer

Capco

Full-time|On-site|Italy - Milan

Join our innovative team at Capco as a Generative AI Engineer where you will be at the forefront of revolutionizing the financial services industry. In this role, you will harness the power of generative artificial intelligence to create cutting-edge solutions that drive efficiency and enhance client experiences. You will collaborate with cross-functional teams, leveraging your skills to design, develop, and implement advanced AI models that solve complex business challenges.

Mar 3, 2026

Apply

Freelance Electrical Engineer & Python Specialist - AI Training

Mindrift

Contract|$31/hr - $31/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

We invite you to submit your CV in English, and please specify your English proficiency level.At Mindrift, we bridge the gap between talented specialists and project-based opportunities in the AI sector for leading technology companies. Our focus is on evaluating, testing, and enhancing AI systems. Please note that this engagement is project-based and not a permanent position.Opportunity OverviewEach project presents unique challenges, and contributors may be involved in:Crafting innovative computational engineering tasks that replicate real-world engineering processes;Developing problems that necessitate Python programming for engineering calculations and simulations;Designing computationally intensive tasks requiring numerical methods or iterative solutions;Creating problems centered around system design, optimization, and analytical evaluations;Formulating challenges based on real research problems or practical engineering applications;Validating solutions using Python and standard engineering libraries;Providing clear documentation for problem statements along with verified correct answers.Candidate ProfileThis role is ideal for engineers experienced in Python who are open to part-time, non-permanent projects. We are particularly interested in candidates who possess:A degree in Electrical Engineering or a related field;Proficiency in Python for numerical validation, with familiarity in MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar programming tools being a plus;At least 2 years of relevant professional experience, including applied, research, or teaching roles;A solid understanding of practical engineering constraints and approximations;Exceptional written English skills (C1+);Professional certifications (e.g., CMME, SAS Certifications, CAP) and experience in international or applied projects are advantageous.Project WorkflowApply → Successfully complete qualification(s) → Engage in a project → Fulfill assigned tasks → Receive compensationExpected CommitmentThe estimated workload for this project is approximately 10–20 hours per week during active phases, contingent on project requirements. This is an estimate and not a guaranteed number of hours.CompensationContributors can earn up to $31 per hour, depending on their experience and the pace of their contributions. Compensation may vary across different projects based on their complexity and required expertise.

Apr 30, 2026

Apply

Freelance AI Trainer with Civil Engineering and Python Expertise

toloka-ai

Contract|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

toloka-ai seeks a Freelance AI Trainer who combines civil engineering experience with solid Python programming skills. This contract position centers on training AI systems, drawing from practical engineering knowledge and coding expertise. Role overview This role involves using civil engineering concepts and Python to help develop and refine AI models. The work calls for both technical understanding of engineering principles and the ability to implement solutions in code. Location Remote work is available, but candidates should be based in Rome, Metropolitan City of Rome Capital, Italy.

Apr 28, 2026

Apply

AI/ML Engineer

airapps

Full-time|On-site|Rome Metropolitain Area

Role Overview airapps is hiring an AI/ML Engineer based in the Rome Metropolitan Area. This role focuses on building and deploying machine learning models to improve our applications. The engineer will work closely with colleagues from different teams, sharing insights and refining algorithms to support product growth. What You Will Do Develop and implement machine learning models for airapps products Collaborate with cross-functional teams to analyze data and identify opportunities for improvement Optimize algorithms to enhance application performance Location Rome Metropolitan Area

Apr 16, 2026

Apply

Freelance Low-Code Automation Engineer - AI Trainer

Mindrift

Part-time|$50/hr - $50/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Mindrift is hiring a Freelance Low-Code Automation Engineer to contribute to the Tendem project. This is a part-time, remote contract role based in Rome, Metropolitan City of Rome Capital, Italy. The position centers on building and improving automation workflows that blend AI and human input. Key responsibilities Create and enhance automation workflows for use in a hybrid AI-human environment Work closely with Tendem Agents to manage repetitive tasks and improve process efficiency Apply structured problem-solving and quality control to keep workflows reliable and scalable across different systems Utilize low-code automation platforms and JavaScript to tailor and optimize solutions Requirements Proven experience with low-code automation tools Strong skills in workflow architecture and process optimization Comfort with customizing automation using JavaScript Interest in flexible, remote freelance work The role involves working with the Tendem project team and using both technical and collaborative skills to streamline operations. For more about the project, visit https://tendem.ai/.

Apr 24, 2026

Apply

Freelance Low-Code Automation Engineer - AI Trainer

Mindrift

Contract|$50/hr - $50/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Mindrift is on the lookout for talented Low-Code Automation Engineers with expertise in Make.com, n8n, and JavaScript to join the innovative Tendem project. In this dynamic role, known as an AI Pilot at Mindrift, you will design and implement advanced automation workflows, creating a seamless integration of human intelligence and AI capabilities.Your primary responsibility will involve collaborating with Tendem Agents who manage repetitive tasks while you lend your automation expertise, analytical skills, and quality assurance to ensure consistent and scalable execution across diverse systems.This part-time remote position is perfectly suited for professionals experienced in low-code automation platforms, workflow design, and JavaScript enhancements.

May 2, 2026

Apply

AI Process Engineer

Entain

Full-time|On-site|Rome

Join our dynamic team at Entain as an AI Process Engineer where you will play a pivotal role in developing and optimizing AI-driven processes. You will leverage your expertise to enhance operational efficiencies and contribute to innovative solutions that propel our business forward. This is an exciting opportunity for professionals passionate about AI and its application in real-world scenarios.

Feb 5, 2026

Apply

Freelance DevOps Engineer (Automation Systems) - AI Project Specialist

Mindrift

Part-time|$50/hr - $50/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Mindrift is looking for a freelance DevOps Engineer to support automation systems for the Tendem project. This part-time role is remote, with a location base in Rome, Metropolitan City of Rome Capital, Italy. The project brings together AI and human workflows, requiring thoughtful infrastructure and reliable automation. Key Responsibilities Design and maintain scalable infrastructure that supports automation workflows in a hybrid AI and human environment. Collaborate with Tendem Agents to streamline and improve repetitive processes. Manage infrastructure with a focus on high reliability and strong performance. Help ensure the stability and growth of automation pipelines as the project expands. Who Succeeds in This Role Engineers with hands-on experience in cloud infrastructure and system deployment. Those who have managed high-load automation environments. People comfortable working remotely and contributing to AI-driven projects. Learn more about the project at https://tendem.ai/.

Apr 24, 2026

Apply

Strategy Consultant - AI Training & Evaluation at toloka-ai | Remote

toloka-ai

Full-time|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

toloka-ai is hiring a Strategy Consultant to focus on AI training and evaluation. This role is fully remote and based in Rome, Metropolitan City of Rome Capital, Italy. Responsibilities Create and improve methodologies for training artificial intelligence systems Enhance evaluation processes to support stronger AI performance and outcomes Work closely with experienced professionals, including those with backgrounds at major consulting firms such as MBB and leading technology companies Collaboration Join a remote team that values expertise and new ideas. You will partner with colleagues who bring experience from top consulting and technology organizations.

Apr 27, 2026

Apply

Freelance Agent Evaluation Engineer

Toloka AI

Contract|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

May 1, 2026

Apply

Full Stack AI Engineer

Lexroom.ai

Full-time|On-site|Milan

Join Lexroom.ai, a pioneer in the realm of legal AI—focused on clarity, speed, and trustworthiness.What started as a visionary concept has evolved into a dependable platform embraced by thousands of legal professionals throughout Europe.Our mission is straightforward: transform legal processes to be faster, clearer, and more reliable, enabling lawyers, law firms, and businesses to dedicate their energy to what truly matters.We are in a phase of rapid growth, supported by esteemed investors and a top-tier team dedicated to excellence, clarity, and meaningful impact.Currently, Lexroom stands as a trusted collaborator, influencing the future of legal AI with the same rigor and precision that define our offerings.Why Choose Lexroom.ai?Set New Standards: Join a team that is defining benchmarks for legal AI across Europe.Collaborate with Top Talent: Work alongside exceptional individuals driven by expertise, curiosity, and ambition.Make a Significant Impact: Your role will empower legal professionals to make quicker, clearer, and more reliable decisions globally.At Lexroom.ai, we prioritize substance over jargon. You will be involved in building something enduring: a reliable platform, a respected reputation, and a new benchmark for the legal sector.Your ResponsibilitiesArchitect and develop agent-driven and RAG-based AI systems to address intricate legal challenges with accuracy and efficiency.Enhance and post-train LLMs using state-of-the-art supervised and reinforcement learning methodologies to elevate response standards.Create and refine expansive search pipelines for LLM-powered agents.Implement and perfect NLP algorithms to extract, organize, and validate data from legal documents.Conduct comprehensive evaluations to identify bottlenecks, assess performance, and drive continuous enhancements.Collaborate closely with legal experts to design innovative solutions.

Feb 2, 2026

Apply

Freelance AI Trainer & Material Scientist with Python Expertise

toloka-ai

Part-time|$29/hr - $29/hr|Remote|Remote — Rome, Metropolitan City of Rome Capital, Italy

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and enhancing AI systems. This is a project-based opportunity and does not offer permanent employment.Opportunity Overview:While each project presents unique challenges, contributors may be tasked with:Creating innovative material engineering problems that replicate real-world engineering workflows;Formulating problems that necessitate Python programming to execute engineering calculations and simulations;Ensuring problems are computationally intensive and require the application of numerical methods or iterative solutions;Designing problems focused on system design, optimization, and analysis;Grounding problems in real research challenges or practical applications from the field of engineering;Validating solutions using Python and established engineering libraries;Clearly documenting problem statements and providing verified correct answers.Qualifications We Seek:This role is ideal for material scientists and engineers with Python experience who are open to non-permanent, part-time project work. Ideally, candidates should possess:A degree in Material Science or a related discipline;Proficiency in Python for numerical validation. Experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or any domain-specific programming languages will also be considered;At least 2 years of professional experience, including applied, research, or teaching roles;A solid understanding of practical engineering constraints and methodologies;Exceptional written communication skills in English (C1+ level).How the Process Works:Apply → Pass qualifications → Join a project → Complete tasks → Get compensated.Project Time Commitment:During active phases, tasks are expected to require approximately 10–20 hours per week, contingent on project demands. Please note this is an estimate and not a guaranteed workload.Compensation:Contributors can earn up to $29 per hour, depending on their contribution level and pace. Compensation may vary across different projects based on scope, complexity, and required expertise.

May 2, 2026

Apply

AI Automation Specialist/Engineer

Jobgether

Full-time|Remote|Italy

Role overview Jobgether is looking for an AI Automation Specialist/Engineer based in Italy. This fully remote position focuses on building automation systems to improve legal support operations. The main goals include streamlining lead generation, optimizing data processing, and making client acquisition workflows more efficient. What you will do Design and build AI-driven automation solutions for extracting, structuring, and enriching data from various sources Integrate processed data into CRM and outreach platforms Collaborate with leadership to identify automation opportunities and deliver scalable, production-ready systems Solve complex data and workflow challenges using advanced AI tools Requirements Technical expertise in automation engineering, data management, and systems integration Experience developing and deploying AI-powered solutions Ability to work well with leadership and cross-functional teams Comfort working independently in a remote environment Location This position is fully remote and based in Italy.

Apr 28, 2026

Apply

Founding AI Full-Stack Engineer

Vibiz

Full-time|On-site|Milan

Join us at Vibiz.ai, the pioneering Vibe Business Platform. Backed by venture capital, we proudly serve hundreds of paying clients as we develop an innovative AI agent designed to autonomously manage and expand businesses—optimizing budgets, making informed decisions, executing strategic actions, and delivering tangible outcomes.We are actively seeking a Founding AI Full-Stack Engineer to accelerate our development at an incredible pace.Key ResponsibilitiesDeliver results daily.Create comprehensive full-stack features from frontend to backend and AI integration.Engage deeply with LLMs, multi-agent systems, and AI-centric user experiences.Transform user complexity into product clarity.Design systems capable of autonomously managing real business operations.Resolve bugs efficiently and effectively.Collaborate directly with founders and users—no intermediaries.Shape the engineering culture from the outset.Technology StackNext.jsTypeScriptLarge Language Models / Multi-agent systemsVercel AI SDKCursor, Claude Code—whichever delivers the fastest results.Prioritize speed over perfection.You AreA comprehensive builder across frontend, backend, and AI.Proactive in delivering daily results without waiting for approval.Deeply engaged with Generative AI, leveraging tools to enhance productivity.Thrives in dynamic environments with minimal specifications.Product-focused, emphasizing outcomes over tasks.A builder at heart, valuing impact over titles.Prioritizes speed over comfort.Essential RequirementsFamiliarity with AI development tools such as Cursor, Claude Code, Copilot, etc.Belief in the transformative power of Generative AI in software development.Proficient in developing full-stack applications using TypeScript and Next.js.Experience with LLMs and/or multi-agent systems.Located within one hour of Milan or willing to relocate (mandatory).Ready to shape the future of our engineering culture from day one.

Mar 23, 2026

Create account — see all 546 results

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, or location & role pages.