Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.What this opportunity involves:
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT:
What we look for:
Why this is hard:
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate
Tasks for this project are estimated to take 30 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation:
Up to $200/hr equivalent, depending on level and pace. Tasks are estimated at ~30 hours each; you set your own schedule.
Senior Python Engineer - AI Coding Agent Evaluation (Freelance) • QC, CA
Join Xsolla as a Lead Engineer, directing the LiveOps Monetization platform’s technical vision.Enjoy a hands-on role leading a skilled team to deliver exceptional gaming solutions.As a Tech Lead at... Show more
A technology company in gaming is seeking a Tech Lead for their LiveOps Monetization platform.This hands-on role emphasizes leadership, overseeing scalable service design, and mentoring engineers.T... Show more
Drive adoption of Cloud FinOps capabilities and best practices within the organization.Develop cost management processes, mechanisms and controls to provide ongoing cost transparency and governance... Show more
Une entreprise de technologie autonome à Québec est à la recherche d'un Ingénieur(e) Senior(e) en apprentissage automatique pour concevoir des systèmes innovants de détection et de suivi.Le candida... Show more
A leading tech consulting firm in Quebec is seeking an experienced Senior Front-End Developer to enhance their vulnerability management platforms.The ideal candidate should have over 5 years of pro... Show more
A growing digital agency in Quebec is looking for an ambitious and energetic Digital Strategist to enhance client relationships and ensure successful project execution.This role requires over 5 yea... Show more
Compensation: Up to $50 per task.We are seeking individuals to complete small, remote market research tasks from home.Your insights help shape future products, services, and public trends.All tasks... Show more
Our client is a global professional services organization.With lots of career growth opportunity, great training and interesting projects, use your PeopleSoft 8.Implementation Consultant, Senior Co... Show more
Are you passionate about making a difference in the world? Look no further! The Borgen Project is an international organization that works at the political level to improve living conditions for pe... Show more
Une entreprise de jeux vidéo à Montréal cherche un Directeur Technique Généraliste de Contenu.Vous dirigerez une équipe technique tout en collaborant avec des partenaires internationaux.Les respons... Show more
Participate in the elicitation of Human Machine Interface (HMI) requirements for multiple embedded systems, and validation of these requirements.Coordinate design activities with system integrators... Show more
Une firme de génie civil recherche un(e) développeur en intelligence d'affaire pour rejoindre son équipe dynamique et polyvalente au Québec.La personne retenue devra avoir un baccalauréat en génie ... Show more
Our client is a global professional services organization.With lots of career growth opportunity, great training and interesting projects, use your Oracle Applications 11i functional experience to ... Show more
A leading consulting firm is seeking a senior professional to drive Cloud FinOps capabilities and optimize public cloud spending.The ideal candidate will have extensive experience in technology fin... Show more
A global professional services organization in Canada is seeking an experienced Implementation Consultant with a proven track record in PeopleSoft 8.The role includes providing client advice, ensur... Show more
A leading global commerce company is seeking a Tech Lead for their Subscriptions platform in Canada, Quebec.This role combines management and hands-on engineering, focusing on leading a backend tea... Show more
Xsolla is a global commerce company with robust tools and services to help developers solve the inherent challenges of the video game industry.From indie to AAA, companies partner with Xsolla to he... Show more
The vulnerability management platforms team is looking for an experienced and proactive senior front-end developer with solid background in enterprise web app development.The candidate should be ab... Show more
A leading aerospace firm based in Canada seeks candidates for an engineering position focused on developing human-machine interface requirements for embedded systems.Candidates should have a Bachel... Show more
A global professional services organization is seeking an Implementation Consultant with Oracle Applications 11i experience.The role involves providing expert input on configuration, building clien... Show more
