Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
What this opportunity involves:
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT:
What we look for:
Why this is hard:
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate
Tasks for this project are estimated to take 30 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation:
Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $200/hr. Because payment is per task, a faster pace raises your effective hourly rate.
Senior Python Engineer - AI Coding Agent Evaluation (Freelance) • BC, CA
Elevate developer efficiency as a Senior Software Engineer specializing in automation tools.Drive impactful solutions across a hybrid model, enhancing product quality through robust processes.In th... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Become an AI-Driven Software Engineer focusing on integrating innovative services for travelers.Utilize advanced AI tools to enhance integration workflows across multiple platforms.This high-owners... Show more
System Engineer – Golang & Kubernetes CRDs.Are you an expert Go engineer who understands Kubernetes beyond ordinary controller development? Do CRDs, watches, informers, admission webhooks, resource... Show more
Shape the future of public transit at Swiftly as a Senior Software Engineer focused on IoT and edge devices.Collaborate to develop innovative solutions that enhance service delivery.At Swiftly, we ... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
As a Senior Software Engineer on our Ancillaries squad, you will build integrations that expand what we can offer travelers—connecting external providers to our platform so partners like Booking.Sk... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Elevate your career at PortBlueSky as a Senior System Engineer, focusing on Golang and Kubernetes CRDs.This role demands expertise in systems engineering for a Kubernetes-native enterprise automati... Show more
Cut+Dry is a fast-growing FoodTech startup searching for flexible go-getters who welcome the challenge of meeting the needs of a rapidly expanding business.Our company is revolutionizing the $300B ... Show more
A growing SaaS company in British Columbia is seeking a Senior DevOps Engineer to streamline software deployment through CI/CD pipelines and optimize cloud infrastructure.The ideal candidate will h... Show more
Location: Greater Vancouver, British Columbia, Canada.Design, implement, and own CI/CD pipelines across multiple services to streamline software development and deployment.Maintain, optimize, and a... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
