Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
What this opportunity involves
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT
What we look for
Why this is hard
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Effort estimate
Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation
Up to $50/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.
Freelance Agent Evaluation Engineer • QC, CA
Join Xsolla as a Lead Engineer, directing the LiveOps Monetization platform’s technical vision.Enjoy a hands-on role leading a skilled team to deliver exceptional gaming solutions.As a Tech Lead at... Show more
A technology company in gaming is seeking a Tech Lead for their LiveOps Monetization platform.This hands-on role emphasizes leadership, overseeing scalable service design, and mentoring engineers.T... Show more
Our client is the leader in business intelligence and analytics.Their software provides one integrated process for analyzing data from every source and gaining the predictive power to drive change ... Show more
Drive adoption of Cloud FinOps capabilities and best practices within the organization.Develop cost management processes, mechanisms and controls to provide ongoing cost transparency and governance... Show more
Une entreprise de technologie autonome à Québec est à la recherche d'un Ingénieur(e) Senior(e) en apprentissage automatique pour concevoir des systèmes innovants de détection et de suivi.Le candida... Show more
A growing digital agency in Quebec is looking for an ambitious and energetic Digital Strategist to enhance client relationships and ensure successful project execution.This role requires over 5 yea... Show more
A leading tech consulting firm in Quebec is seeking an experienced Senior Front-End Developer to enhance their vulnerability management platforms.The ideal candidate should have over 5 years of pro... Show more
Start earning money fast and be your own boss.Instacart is a leading retail enablement platform that works with grocers and retailers to transform how people shop.Instacart’s platform helps people ... Show more
With the objective of consolidating our international strategy through expansion into the African market, we are looking to bring on board seasoned talents for strategic partnership projects.We are... Show more
Participate in the elicitation of Human Machine Interface (HMI) requirements for multiple embedded systems, and validation of these requirements.Coordinate design activities with system integrators... Show more
Compensation: Up to $50 per task.We are seeking individuals to complete small, remote market research tasks from home.Your insights help shape future products, services, and public trends.All tasks... Show more
Une entreprise de jeux vidéo à Montréal cherche un Directeur Technique Généraliste de Contenu.Vous dirigerez une équipe technique tout en collaborant avec des partenaires internationaux.Les respons... Show more
Our client is a global professional services organization.With lots of career growth opportunity, great training and interesting projects, use your Oracle Applications 11i functional experience to ... Show more
A leading consulting firm is seeking a senior professional to drive Cloud FinOps capabilities and optimize public cloud spending.The ideal candidate will have extensive experience in technology fin... Show more
Une société d'ingénierie reconnue au Québec recherche un ingénieur de chantier dans le domaine du génie civil.Les responsabilités incluent la surveillance des travaux et la validation des documents... Show more
A leading global commerce company is seeking a Tech Lead for their Subscriptions platform in Canada, Quebec.This role combines management and hands-on engineering, focusing on leading a backend tea... Show more
The vulnerability management platforms team is looking for an experienced and proactive senior front-end developer with solid background in enterprise web app development.The candidate should be ab... Show more
Xsolla is a global commerce company with robust tools and services to help developers solve the inherent challenges of the video game industry.From indie to AAA, companies partner with Xsolla to he... Show more
A leading business intelligence firm in Quebec is seeking a professional to engage closely with sales teams and customers.Responsibilities include supporting sales strategies, preparing presentatio... Show more
A global professional services organization is seeking an Implementation Consultant with Oracle Applications 11i experience.The role involves providing expert input on configuration, building clien... Show more
