Talent.com
Turing
Remote Senior Software Engineer – LLM Evaluation (US-based)Turing • Ahuntsic North, ca
No longer accepting applications
Remote Senior Software Engineer – LLM Evaluation (US-based)

Remote Senior Software Engineer – LLM Evaluation (US-based)

Turing • Ahuntsic North, ca
6 days ago
Job type
  • Full-time
  • Remote
Job description
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

Ideal Background This role is ideal for engineers who have shipped high-impact products at fast-moving companies like Stripe, Airbnb, Cloudflare, Datadog, Coinbase, or similar high-growth engineering environments. We especially welcome graduates from leading programs such as Harvard, Columbia, Princeton, Yale, University of Pennsylvania, and comparable institutions—though exceptional experience and skill always take precedence over pedigree.

Project Overview Typical Day

Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable.

Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.

Build agents and automated verification tools in Python that can verify the quality of code and identify error patterns.

Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them.

Design verification mechanisms that can automatically verify a solution to a software engineering task.

Required Skills

Several years of software engineering experience (3 years or more)

Strong expertise in Python with deep knowledge of frameworks, tooling, and best practices for building production‑grade software.

Experience building full‑stack applications and deploying scalable software using modern languages and tools.

Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.

Excellent oral and written communication skills for clear, structured evaluation rationales.

Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week

Type: Contractor (no medical/paid leave)

Duration: 1 month (potential extensions based on performance and fit)

Location Candidates must be based in the United States

#J-18808-Ljbffr
Create a job alert for this search

Remote Senior Software Engineer – LLM Evaluation (US-based) • Ahuntsic North, ca

Similar jobs

Senior ML Engineer, Ranking — Remote

QuoraMontreal (administrative region), QC, CA
Remote
Full-time

A leading technology firm is seeking a Senior Machine Learning Engineer to improve recommendation models and apply machine learning techniques.This remote position requires 3+ years of experience i... Show more

 • Promoted

Innovative Senior Software Engineer for Remote Workday Integration Projects

Insight GlobalMontreal (administrative region), QC, CA
Remote
Full-time

Transform your career as a Senior Software Engineer focusing on innovative Workday integration solutions.This fully remote role offers an opportunity to make a significant impact through your techn... Show more

 • Promoted

Senior AI Software Engineer: Agent Systems (Remote)

ChatGPT JobsMontreal, Montreal (administrative region), CA
Remote
Full-time

A tech innovator in digital media seeks a Senior Software Engineer to develop LLM-powered systems that impact media planning and execution.The role requires 5+ years of software engineering experie... Show more

 • Promoted

Senior Software Engineer (Remote)

PolicyMeMontreal (administrative region), QC, CA
Remote
Full-time

We’re on a mission to modernize insurance, making it simpler, more accessible, and customer‑first.The insurance industry is a $1T market that’s remained largely untouched by the digital revolution,... Show more

 • Promoted

Senior Software Engineer - Remote Role

Ontario Mutual Insurance AssociationMontreal (administrative region), QC, CA
Remote
Full-time

Elevate your career with The Commonwell as a Senior Software Engineer in a fully remote setting, driving software excellence and innovation.You'll play a crucial role in mentoring and project deliv... Show more

 • Promoted

Senior ML Engineer, Underwriting — Remote

AffirmMontreal (administrative region), QC, CA
Remote
Full-time

A fintech company is seeking a Senior Staff Machine Learning Engineer to lead advanced ML initiatives.This remote-first position based in Prince Edward Island involves collaborating with cross-func... Show more

 • Promoted

Senior Cloud Software Engineer - Remote (Canada)

AutodeskMontreal, Montreal (administrative region), CA
Remote
Full-time

A leading software company is seeking a Senior Software Developer to join their agile team focusing on Autodesk Preconstruction, a cloud service enhancing construction efficiency.The ideal candidat... Show more

 • Promoted

Senior Software Engineer — Remote, Equity & Growth

Octopusapp Inc.Montreal (administrative region), QC, CA
Remote
Full-time

A leading tech company in Canada is seeking a Senior Software Engineer to join their Product Software Engineering team.The ideal candidate should have experience in full-stack development, a strong... Show more

 • Promoted

Senior Software Engineer, Email Platform (Remote)

OneSignal, Inc.Montreal (administrative region), QC, CA
Remote
Full-time

A progressive technology company based in Canada is seeking a Senior Software Engineer to develop customer engagement products.You will collaborate with cross-functional teams to implement features... Show more

 • Promoted

Senior Software Engineer - Secure LLM Infra (Remote)

LLMMontreal (administrative region), QC, CA
Remote
Full-time

A technology solutions provider in Canada is seeking a Senior Software Engineer to architect backend systems for secure LLM deployment.The ideal candidate should have over 5 years of experience in ... Show more

 • Promoted

Senior Software Engineer — Build Bitcoin Future (Remote)

ShakepayMontreal (administrative region), QC, CA
Remote
Full-time

A leading Canadian cryptocurrency platform is seeking a Senior Software Engineer to innovate financial products and help Canadians build wealth.The ideal candidate has over 5 years of experience, i... Show more

 • Promoted

AI Software Engineer with LLM Focus

PulsoraMontreal (administrative region), QC, CA
Full-time

Embrace the future of technology as an AI Software Engineer specializing in Large Language Models.Work remotely from Canada and contribute to innovative AI solutions.In this full-time position, you... Show more

 • Promoted

Senior Distributed Diffusion ML Engineer — Remote

Bagel LabsMontreal (administrative region), QC, CA
Remote
Full-time

A leading machine learning research lab is looking for an expert in distributed systems to design scalable infrastructure for diffusion models.The ideal candidate will have substantial experience i... Show more

 • Promoted

Lead Evaluator for Software Engineering Responses in Multiple Languages

Mercor AiMontreal (administrative region), QC, CA
Full-time

Step into a lead evaluator position focused on enhancing code quality in a multi-language landscape.Utilize your extensive software engineering experience to assess LLM-generated responses with pre... Show more

 • Promoted

Senior Software Engineer - Ads (Remote, Equity Eligible)

InstacartMontreal (administrative region), QC, CA
Remote
Full-time

A leading grocery technology company is seeking a Senior Software Engineer to join their Ads team.This remote role involves building reporting solutions and ensuring a seamless flow of data for adv... Show more

 • Promoted

Senior Software Engineer - Remote, Scale & Mentor Teams

InvertMontreal (administrative region), QC, CA
Remote
Full-time

A forward-thinking biotechnology company is seeking a Senior Software Engineer to join their remote-first team.The role involves shipping features and making technical decisions to support scaling ... Show more

 • Promoted

Remote Software Engineer — Train & Evaluate AI Chatbot Code

DataAnnotationMontreal, Montreal (administrative region), CA
Remote
Full-time

An innovative company is seeking a skilled Software Engineer to help train AI chatbots.This exciting remote role allows you to work on your own schedule while contributing to the development of cut... Show more

 • Promoted

Senior ML & Software Engineer — Remote & Flexible Hours

OsedeaMontreal, Montreal (administrative region), CA
Remote
Full-time

A dynamic tech firm in Montreal is seeking a Senior Software Developer specialized in Machine Learning.This role involves developing AI-driven software solutions and mentoring team members.The idea... Show more