Talent.com
YO IT Consulting
Python Software Engineer - Ai TrainingYO IT Consulting • Toronto, Canada
No longer accepting applications
Python Software Engineer - Ai Training

Python Software Engineer - Ai Training

YO IT Consulting • Toronto, Canada
7 days ago
Job type
  • Full-time
  • Part-time
Job description
Work Mode:

Remote

Engagement Type:

Independent Contractor

Schedule:

Full-Time or Part-Time Contract

Language Requirement:

Fluent English

Role Overview We partner with leading AI teams to improve the quality, usefulness, and reliability of general‑purpose conversational AI systems. This project focuses specifically on evaluating and improving how AI systems reason about code, generate programming solutions, and explain technical concepts across various complexity levels. The role involves rigorous technical evaluation of AI‑generated responses in coding and software engineering contexts.

What You’ll Do

Evaluate LLM‑generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness

Conduct fact‑checking using trusted public sources and authoritative references

Conduct accuracy testing by executing code and validating outputs using appropriate tools

Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies

Assess code quality, readability, algorithmic soundness, and explanation quality

Ensure model responses align with expected conversational behavior and system guidelines

Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines

Who You Are

You hold a BS, MS, or PhD in Computer Science or a closely related field

You have significant real‑world experience in software engineering or related technical roles

You are an expert in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust)

You are able to solve HackerRank or LeetCode Medium and Hard‑level problems independently

You have experience contributing to well‑known open‑source projects, including merged pull requests

You have significant experience using LLMs while coding and understand their strengths and failure modes

You have strong attention to detail and are comfortable evaluating complex technical reasoning, identifying subtle bugs or logical flaws

Nice‑to‑Have Specialties

Prior experience with RLHF, model evaluation, or data annotation work

Track record in competitive programming

Experience reviewing code in production environments

Familiarity with multiple programming paradigms or ecosystems

Experience explaining complex technical concepts to non‑expert audiences

What Success Looks Like

You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model‑generated code, technical concepts, and system design discussions

Your feedback improves the correctness, robustness, and clarity of AI coding outputs

You deliver reproducible evaluation artifacts that strengthen model performance

#J-18808-Ljbffr
Create a job alert for this search

Python Software Engineer - Ai Training • Toronto, Canada

Similar jobs

Software Engineer: Python & AI Focus

MercorToronto
Full-time

Join Mercor remotely as a Software Engineer specializing in Python to advance AI solutions.This role offers a competitive $100/hour and a commitment of 20 hours per week on a contract basis.The pos... Show more

 • Promoted

Senior Python Engineer to Develop AI-Powered Tax Systems

TaxgptToronto, ON, CA
Full-time

Join the cutting-edge of tax solutions as a Senior Python Engineer! Work remotely to design and build scalable backend systems using Django, influencing workflows for professionals and SMBs.In this... Show more

 • Promoted

Software Engineer III - Python

EmburseToronto, ON, CA
Full-time

At Emburse, you’ll not just imagine the future – you’ll build it.As a leader in travel and expense solutions, we are creating a future where technology drives business value and inspires extraordin... Show more

 • Promoted

Senior AI Engineer, Retrieval & LLM Systems

ToastToronto, ON, CA
Full-time

A technology company seeks a Software Engineer, AI to join their Toronto team.In this role, you will design and implement AI-powered retrieval systems, using your backend expertise and understandin... Show more

 • Promoted

Instructor, AI & Machine Learning with Python

Circuit Stream Inc.Toronto, ON, CA
Full-time

Circuit Stream is a leader in future technology skills training and learning content.We offer world‑class educational services for teen and adult learners with a focus on the skills needed to lever... Show more

 • Promoted

Senior Software Engineer Specializing in Python and AWS Architecture

Scribd, Inc.Toronto, ON, CA
Full-time

Take your engineering expertise to the next level as a Senior Software Engineer.Design event-driven systems in Python and work with cloud technologies to enrich metadata on a global scale.This posi... Show more

 • Promoted

AI and Generative AI Developer: Build Solutions in Python

VirtusaToronto, ON, CA
Full-time

Elevate your career as an AI and Generative AI Developer by building solutions that impact the business landscape.Leverage your Python skills to support high-impact ML projects and experiments effe... Show more

 • Promoted

Generative AI Engineer — Python + Cloud Solutions

Tekgence IncToronto, ON, CA
Full-time

A technology solutions provider is looking for a Recruitment Account Manager to work in Toronto.The ideal candidate has a strong background in Generative AI, machine learning, and cloud technologie... Show more

 • Promoted

AI Application Developer Using Python

Dayforce US, Inc.Toronto, ON, CA
Full-time

Transform support processes as an AI Application Developer specializing in Python and OpenAI.Contribute to cutting-edge projects within a hybrid work environment.Become a valuable member of the Adv... Show more

 • Promoted

Innovative Python Software Engineer for Data Transformation Projects

ScotiabankToronto, ON, CA
Full-time

Join a leading-edge team as a Software Engineer specializing in Python and analytics transformation.Your skills will help modernize platforms and enhance data insights for better client management.... Show more

 • Promoted

Senior Python Engineer for AI Training & Code Review

G2i Inc.Toronto, ON, CA
Full-time

A leading AI solutions company in Winnipeg is seeking experienced software engineers to join their annotation team, creating training data for AI models.This position requires a solid background in... Show more

 • Promoted

Senior AI Python Software Engineer (Perm, Canada, Remote + Travel)

NearformToronto, Ontario, Canada
Remote
Full-time +1

This is a full-time, permanent opportunity for candidates based in Canada and authorised to work without sponsorship, with a preference for those located on the East Coast.Visa sponsorship is not a... Show more

 • Promoted

Software Engineer, Python

AutoSyncGreater Toronto Area, ON, CA
Full-time

TRADER Corporation is a trusted Canadian leader in online media, dealer and lender services.AutoSync, and Dealertrack Canada.Quebec) offers the largest inventory of new and used cars in Canada, wit... Show more

 • Promoted

Software Engineer for AI Platforms

InkerosToronto, ON, CA
Full-time

Join Inkeros as a Software Engineer and help redefine AI-driven software development.This role focuses on building innovative solutions with high-performance tools and autonomy.At Inkeros, we are l... Show more

 • Promoted

Software Engineer in AI Data Automation

WaabiToronto, ON, CA
Full-time

Step into a pivotal Software Engineer role at Waabi, specializing in AI data automation and pipeline development.Your work will contribute to advancing self-driving technologies in a hybrid work mo... Show more

 • Promoted

Freelance Automotive Engineering & Python Expert - AI Trainer

MindriftToronto, ON, CA
Part-time +1

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.Participation is project-based, not permanent ... Show more

 • Promoted

Senior Python Engineer, Remote Data Integrations & AI Tools

ClickHouseToronto, ON, CA
Remote
Full-time

A leading data analytics company in Canada is seeking a Senior Software Engineer specializing in Python and the data ecosystem.This role requires extensive experience in software development and a ... Show more

 • Promoted

GenAi Engineer

Pacer GroupToronto, ON, Canada
Full-time

Seeking a skilled professional with expertise in Machine Learning, Deep Learning, NLP, and RAG-based solutions.Must have strong programming experience in Python and the ability to build and deploy ... Show more