Talent.com
LawZero
Director of AI Evaluations at LawZeroLawZero • Montreal (administrative region), QC, Canada
Director of AI Evaluations at LawZero

Director of AI Evaluations at LawZero

LawZero • Montreal (administrative region), QC, Canada
30+ days ago
Job type
  • Full-time
Job description
Lead LawZero's evaluation efforts as Director of AI Evaluations, ensuring trustworthy assessments of advanced AI systems. Shape the future of AI safety and integrity. As a key hire, you will design the evaluation framework at LawZero, fostering independent assessments that meet the highest credibility standards. You will guide a team in developing benchmarks for the Scientist AI, emphasizing safety and capability measurement. Collaborate closely with research and product teams to ensure accurate evaluations that enhance public trust. Key Responsibilities: • Define and implement evaluation strategies for AI systems • Build a team of experts in machine learning evaluation • Design benchmarks to apply consistently across AI models • Oversee the development of datasets and evaluation tools • Publicly communicate evaluation findings for transparency Requirements: • MSc or higher in machine learning, computer science • 10+ years in ML, including leadership in evaluation • Expertise in safety evaluations and adversarial techniques • Proven ability to create evaluation environments from scratch • Strong ability to convey complex results to varied audiences Elevate AI safety through rigorous evaluations and team leadership at LawZero. #J-18808-Ljbffr
Create a job alert for this search

Director of AI Evaluations at LawZero • Montreal (administrative region), QC, Canada

Similar jobs

AI Partnerships Solutions Engineer at FirstPrinciples

FirstPrinciplesMontreal (administrative region), QC, CA
Full-time

Shape the future of AI in science as a Solutions Engineer at FirstPrinciples.Focus on building and operationalizing partnerships while working remotely with a diverse team.At FirstPrinciples, we ar... Show more

 • Promoted

Local Study Leadership at Parexel

ParexelMontreal (administrative region), QC, CA
Full-time

Elevate clinical study delivery as the Local Study Associate Director at Parexel, ensuring quality and compliance in clinical trials.Lead Local Study Teams to achieve project success.In this role, ... Show more

 • Promoted

Senior Technology Counsel at Cohere

CohereMontreal (administrative region), QC, CA
Full-time

Become a Senior Technology Counsel at Cohere, where you'll shape the legal framework for our AI products in a collaborative, remote-friendly setting.This role is central to managing legal risks and... Show more

 • Promoted

Senior Customer Developer for AI Solutions at Google

GoogleMontreal (administrative region), QC, CA
Full-time

Become a pivotal force in customer transformation with Google Cloud as a Senior Customer Developer for AI Solutions.Utilize your extensive experience to shape AI infrastructure strategies effective... Show more

 • Promoted

Senior Technical Director Remote at Nearform

NearForm LtdMontreal (administrative region), QC, CA
Remote
Full-time

Drive technology and strategy as a Senior Technical Director at Nearform, working remotely from Canada.Lead teams to achieve excellence across various projects.Nearform seeks a Technical Director w... Show more

 • Promoted

Data Engineering Specialist at Borealis AI

Borealis AIMontreal (administrative region), QC, CA
Full-time

Shape the future of data at Borealis AI as a Data Engineering Specialist.Engage with groundbreaking technologies that influence business decisions and drive progress.This role focuses on managing t... Show more

 • Promoted

Domain Architect, Data Strategy at PSP Investments

PSP Investments | Investissements PSPMontreal (administrative region), QC, CA
Full-time

Elevate your career at PSP Investments as a Domain Architect focused on enterprise data strategy.This role emphasizes creating a unified data architecture to support advanced analytics and AI initi... Show more

 • Promoted

AI Integration Engineer at Cohere

Jaide HealthMontreal (administrative region), QC, CA
Full-time

Become a catalyst for AI transformation with Cohere as a Forward Deployed Engineer.This hybrid role across Toronto, Ottawa, and Montreal is pivotal to enterprise AI success.In this full-time positi... Show more

 • Promoted

Enterprise GenAI Engineer at Bounteous

jobr.proMontreal (administrative region), QC, CA
Full-time

Lead enterprise GenAI initiatives as an Engineer at Bounteous, specializing in operational AI-powered platforms for document data extraction.This role demands a strong foundation in practical AI ap... Show more

 • Promoted

Senior Consultant Manager at KPI

KPI Digital SolutionsMontreal (administrative region), QC, CA
Full-time

Drive business impact as a Senior Consultant Manager at KPI, a leader in Data, Analytics & AI.Experience a hybrid work model while partnering with clients to enhance their data strategies.In this r... Show more

 • Promoted

Senior Director of AI Development at EA

Electronic Arts Inc.Montreal (administrative region), QC, CA
Full-time

Join Electronic Arts as a Senior Director of AI Development, where you will lead a global team to innovate and enhance player experiences in live service titles.As the Senior Director, you will ove... Show more

 • Promoted

Director of Engineering at Stay22

Traveltechessentialistmontreal (administrative region), qc, Canada
Full-time

Become the Director of Engineering at Stay22, a hybrid role based in Montreal.Lead a team in architecting scalable systems for a revolutionary AI-powered platform.As the Director of Engineering, yo... Show more

 • Promoted

AI Development Engineer at Novisto

DiagramMontreal (administrative region), QC, CA
Full-time

Join Novisto as an AI Development Engineer, contributing to their mission of automating tasks with AI technologies.This full-stack role emphasizes both collaboration and technical execution in a ra... Show more

 • Promoted

Senior Business Intelligence Lead at AtkinsRéalis

AtkinsRéalisMontreal (administrative region), QC, CA
Full-time

Lead impactful BI initiatives for AtkinsRéalis as a Senior Business Intelligence & Analytics Lead.This role integrates technical acumen with strategic analytics development in a hybrid setting.As t... Show more

 • Promoted

AI Product Manager at Planned

Human Ventures LLCMontreal (administrative region), QC, CA
Full-time

Lead product innovation at Planned as an AI Product Manager within our event management platform.Drive user-centric features and leverage AI to streamline corporate event logistics.This role offers... Show more

 • Promoted

Senior Value Consultant at Ashby

AshbyMontreal (administrative region), QC, CA
Full-time

Elevate Ashby's value sales strategy as our first Senior Value Consultant.Own the development of frameworks that enhance client understanding and satisfaction.In this influential role, you'll bridg... Show more

 • Promoted

Client Strategy Director at Directive Consulting

DirectiveMontreal (administrative region), QC, CA
Full-time

Drive client success and strategic initiatives as Directive's Account Director, focusing on B2B marketing excellence.Work remotely while overseeing portfolio management and client growth strategies... Show more

 • Promoted

Director of AI Evaluations at LawZero

LawZeroMontreal
Full-time

Lead LawZero's evaluation efforts as Director of AI Evaluations, ensuring trustworthy assessments of advanced AI systems.Shape the future of AI safety and integrity.As a key hire, you will design t... Show more

 • Promoted

AI Systems Director at Jobber

JobberMontreal (administrative region), QC, CA
Full-time

Lead revolutionary AI integration at Jobber as the AI Systems Director.Own the transition from basic AI tools to holistic, intelligent business workflows for service industries.In this pivotal lead... Show more

 • Promoted

AI Product Strategy Director at Toolbx

TOOLBXMontreal (administrative region), QC, CA
Full-time

Join Toolbx as the Director of Product, focusing on AI and automation.Engage in roadmap management and hands-on execution in this fully remote position, leading a small team of PMs.In this strategi... Show more