Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
What this opportunity involves
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT
What we look for
Why this is hard
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Effort estimate
Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation
Up to $50/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.
Freelance Agent Evaluation Engineer • MB, CA
At Lumenalta, we create impactful software solutions that drive innovation and transform businesses.Since 2000, we’ve partnered with visionary leaders to build cutting‑edge tech, solve complex chal... Show more
Transform your career with SGI as a Strategic Application Architect, specializing in merging technical design with business strategy.This remote role allows you to drive productivity within our tea... Show more
Location : Montreal, QC hybrid.CMC Electronics (CMC) has earned an international reputation for innovation and excellence in the design, manufacturing and support of electronic products for the avi... Show more
A global digital solutions company is seeking an Online Data Analyst with proficiency in Lithuanian and English.This part-time entry-level role involves enhancing the quality of digital maps used w... Show more
A leading technology firm is seeking a Computer Science Expert to join as a Freelance Data Partner.This remote role involves developing complex question-and-answer pairs in your area of expertise a... Show more
We are seeking a chemistry professional to join our team to train AI models.Your responsibilities will include measuring the progress of AI chatbots, evaluating their logic, and solving problems to... Show more
Compensation: Up to $50 per task.We are seeking individuals to complete small, remote market research tasks from home.Your insights help shape future products, services, and public trends.All tasks... Show more
A leading digital AI firm is seeking an Online Data Analyst to work remotely, specifically targeting Latvian speakers.In this entry-level part-time role, you will enhance digital maps used by milli... Show more
A tech-driven company specializing in innovative software solutions is looking for a Mid-Senior Level Engineer.This fully remote position involves conducting candidate interviews, coordinating with... Show more
Division – Digital and Information Services.Work Location – Saskatchewan, Manitoba, Alberta and Ontario.This role is eligible for a hybrid or remote work option in these provinces where we operate.... Show more
Lead the mechanical delivery of cutting-edge data centre projects as a Mechanical Project Manager.Focus on HVAC and plant infrastructure in a site-based/hybrid position.In this essential role, you'... Show more
Online Data Analyst (Lithuanian Language) Remote.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Direct message the job poster from TELUS Digital AI D... Show more
Build the foundation for a successful career in geotechnical engineering with a great team.When we say we’re full-service, we mean it.You’ll find us in the office, on site, and in the lab.We work i... Show more
Media Search Analyst - Work from Home (Canada).Get AI-powered advice on this job and more exclusive features.Direct message the job poster from TELUS Digital AI Data Solutions.Sourcing Analyst @ TE... Show more
A prominent engineering firm in Canada seeks an Intermediate Civil Engineer for their Water & Wastewater Design team.This position involves designing and delivering infrastructure projects that sus... Show more
Computer Science Expert - Data Partner (Remote).Join us as a Freelance Data Partner and work remotely with flexible hours.Are you ready to use your domain knowledge to advance AI? We are seeking hi... Show more
Advance in your career as a Senior Geotechnical Engineer with a focus on dam safety and design.Enjoy a role that balances technical challenges with a supportive and inclusive work environment.In th... Show more
A dynamic fintech company is seeking a Senior Software Developer to join their team in Winnipeg, Manitoba.The role demands strong coding abilities, excellent communication skills, and a minimum of ... Show more
A leading technology solutions provider in Canada is seeking a detail-oriented Online Data Analyst for a freelance opportunity.This role allows you to work from home at your own pace while contribu... Show more
A leading engineering firm in Canada is seeking a Senior Geotechnical Engineer to join their team.You will support the design and analysis of dams, reservoirs, and hydropower projects.Ideal candida... Show more
