Talent.com
Senior AI Data Engineer
Senior AI Data EngineerVeeva Systems • Ottawa, ON, CA
Senior AI Data Engineer

Senior AI Data Engineer

Veeva Systems • Ottawa, ON, CA
Il y a 9 jours
Type de contrat
  • Temps plein
Description de poste

Join to apply for the AI Data Engineer role at Veeva Systems.

Get AI-powered advice on this job and more exclusive features.

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth potential ahead.

At the heart of Veeva are our values : Do the Right Thing, Customer Success, Employee Success, and Speed. We're not just any public company – we made history in 2021 by becoming a public benefit corporation (PBC), legally bound to balancing the interests of customers, employees, society, and investors.

As a Work Anywhere company, we support your flexibility to work from home or in the office, so you can thrive in your ideal environment.

Join us in transforming the life sciences industry, committed to making a positive impact on its customers, employees, and communities.

The Role

This role is responsible for ensuring the reliability, accuracy, and safety of our Veeva AI Agents through rigorous evaluation and systematic validation methodologies. We're looking for experienced candidates with :

  • A meticulous, critical, and curious mindset with a dedication to product quality in a rapidly evolving technological domain
  • Exceptional analytical and systematic problem‑solving capabilities
  • Excellent ability to communicate technical findings to both engineering and product management audiences
  • Ability to learn application areas quickly

Thrive in our Work Anywhere environment : We support your flexibility to work remotely or in the office within Canada or the US, ensuring seamless collaboration within your product team's time zone.

What You’ll Do

  • Evaluation Strategy & Planning : Define and establish comprehensive evaluation strategies for new AI Agents. Prioritize the integrity and coverage of test data sets to reflect real‑world usage and potential failure modes.
  • LLM Output Integrity Assessment : Programmatically and manually evaluate the quality of LLM‑generated content against predefined metrics (e.g., factual accuracy, contextual relevance, coherence, and safety standards).
  • Creating High‑Fidelity Datasets : Design, curate, and generate diverse, high‑quality test data sets, including challenging prompts and scenarios. Evaluate LLM outputs to proactively identify system biases, unsafe content, hallucinations, and critical edge cases.
  • Automation of Evaluation Pipelines : Develop, implement, and maintain scalable automated evaluations to ensure efficient, continuous validation of agent behavior and prevent regressions with new features and model updates.
  • Root Cause Analysis : Understand model behaviors and assist in the trace and root‑cause analysis of identified defects or performance degradations.
  • Reporting & Performance Metrics : Clearly document, track, and communicate performance metrics, validation results, and bug status to the broader development and product teams.
  • Requirements

  • Data Integrity & Validation : A strong, specialized understanding of data quality principles, including methods for validating datasets against bias, integrity concerns, and quality standards. Ability to craft diverse and adversarial test data to uncover AI edge cases.
  • Prompt Engineering & Model Expertise : Demonstrated skill in advanced prompt engineering techniques to create evaluation scenarios that test the AI's reasoning, action planning, and adherence to system instructions. Deep knowledge of LLM common failure modes (hallucination, incoherence, jailbreaking).
  • Automated Evaluation Implementation : 5+ years of experience designing and deploying automated evaluation pipelines to assess complex, agentic AI behaviors. Familiarity with quality metrics such as task success rate, semantic similarity, and sentiment analysis for output measurement.
  • Debugging Agentic Systems : Must be comfortable with the specific challenges of debugging agentic systems, including tracing and interpreting an agent's internal reasoning, tool use, and action sequence to pinpoint failure points.
  • Programming & Frameworks : 5+ years of experience using Python to develop custom evaluation frameworks, writing scripts, and integrating pipelines with CI / CD systems. Familiarity with standard test automation tools (e.g., Pytest, modern web automation tools).
  • Bachelor's degree in Data Science, Machine Learning, Computer Science, or a related field, with experience in Gen AI / LLMs.
  • High work ethic. Veeva is a hard‑working company.
  • High integrity and honesty. Veeva is a PBC and a “do the right thing” company. We expect that from all employees.
  • Applicants must have the unrestricted right to work in the United States or Canada. Veeva will not provide sponsorship at this time.
  • Learn More

  • Engineer Perspective : 3 Reasons to Consider Veeva
  • Engineering at Veeva
  • Perks & Benefits

  • Medical, dental, vision, and basic life insurance
  • PTO and company‑paid holidays
  • Retirement programs
  • 1% charitable giving program
  • Compensation

  • Base pay : $85,000 - $225,000 CAD
  • The salary range listed here has been provided to comply with local regulations and represents a potential base salary range for this role. Please note that actual salaries may vary within the range above or below, depending on experience and location. We look at compensation for each individual and base our offer on your unique qualifications, experience, and expected contributions. This position may also be eligible for other types of compensation in addition to base salary, such as variable bonus and / or stock bonus.
  • Veeva’s headquarters is located in the San Francisco Bay Area with offices in more than 15 countries around the world.

    Veeva is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity or expression, religion, national origin or ancestry, age, disability, marital status, pregnancy, protected veteran status, protected genetic information, political affiliation, or any other characteristics protected by local laws, regulations, or ordinances. If you need assistance or accommodation due to a disability or special need when applying for a role or in our recruitment process, please contact us at talent_accommodations@veeva.com.

    Referrals increase your chances of interviewing at Veeva Systems by 2x.

    #J-18808-Ljbffr

    Créer une alerte emploi pour cette recherche

    Senior AI Data Engineer • Ottawa, ON, CA

    Offres similaires
    Lead ML Engineer for AI-Driven EDA Tools

    Lead ML Engineer for AI-Driven EDA Tools

    Synopsys, Inc. • Ottawa H2B, ON, Canada
    Temps plein
    A leading technology company in Ottawa is seeking a highly skilled software engineer with over 8 years of experience to work on AI and machine learning solutions in electronic design automation.The...Voir plus
    Dernière mise à jour : il y a 3 jours • Offre sponsorisée
    Senior ML Engineer & Tech Lead — NLP, MLOps, Mentoring

    Senior ML Engineer & Tech Lead — NLP, MLOps, Mentoring

    SurveyMonkey • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein
    A global survey platform is seeking an experienced Data Scientist to lead projects and mentor junior team members.You will advocate for data-driven practices while collaborating across teams.Requir...Voir plus
    Dernière mise à jour : il y a 8 jours • Offre sponsorisée
    Senior Data Scientist, Power Systems Analytics

    Senior Data Scientist, Power Systems Analytics

    Hydroone • Ottawa H2B, ON, Canada
    Temps plein
    A leading electricity provider in Ontario is seeking an experienced Data Scientist to join their team.The role involves leading data science practices, performing analysis on operational data, and ...Voir plus
    Dernière mise à jour : il y a 8 jours • Offre sponsorisée
    Public Sector CTO — AI & Cloud Transformation (Canada)

    Public Sector CTO — AI & Cloud Transformation (Canada)

    ServiceNow • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein
    A leading technology firm is seeking a Chief Technology Officer for the Canada Public Sector to drive growth and support digital transformation initiatives. This pivotal role requires a strong leade...Voir plus
    Dernière mise à jour : il y a 3 jours • Offre sponsorisée
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Solink Corp. • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein +1
    Ottawa, ON | Hybrid (Eastern Time, within Canada).Eugenia Kondratova, Senior Technical Manager, AI.At Solink, our mission is to safeguard what matters most. We help businesses know sooner and act fa...Voir plus
    Dernière mise à jour : il y a 19 jours • Offre sponsorisée
    Software Engineer II - AI / ML for Personalization & Search

    Software Engineer II - AI / ML for Personalization & Search

    CNN • Ottawa H2B, ON, Canada
    Temps plein
    A leading broadcasting and media company in Ontario is seeking a Software Developer II for AI / ML products.You will collaborate with engineers to create innovative solutions, focusing on machine lea...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Senior ASIC Design Engineer for AI / HPC SoCs

    Senior ASIC Design Engineer for AI / HPC SoCs

    BTA Design Services • Ottawa H2B, ON, Canada
    Temps plein
    A leading design services firm in Ottawa is seeking a Senior ASIC Design Engineer to join their team.This role involves translating system-level requirements into architecture, developing synthesis...Voir plus
    Dernière mise à jour : il y a 12 jours • Offre sponsorisée
    ASIC Digital Design, Senior Staff Engineer - 13121

    ASIC Digital Design, Senior Staff Engineer - 13121

    Synopsys Inc • Ottawa H2B, ON, Canada
    Temps plein
    ASIC Digital Design, Senior Staff Engineer - 13121.Be among the first 25 applicants.At Synopsys, we drive the innovations that shape the way we live and connect. Our technology is central to the Era...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Senior AI / ML Engineer — Hybrid in Ottawa (Cloud & Edge)

    Senior AI / ML Engineer — Hybrid in Ottawa (Cloud & Edge)

    Solink Corp. • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein
    A leading technology company in Ottawa is seeking a Senior AI / ML Engineer to design, build, and deploy machine learning solutions. This role involves working across various domains including researc...Voir plus
    Dernière mise à jour : il y a 19 jours • Offre sponsorisée
    Senior Go Engineer - Cloud / Kubernetes & AI Integrations

    Senior Go Engineer - Cloud / Kubernetes & AI Integrations

    Flexera • Ottawa H2B, ON, Canada
    Temps plein
    A leading technology solutions provider in Ottawa is seeking a talented Senior Software Engineer to join their platform team. The ideal candidate will have extensive experience in Go programming, a ...Voir plus
    Dernière mise à jour : il y a 14 jours • Offre sponsorisée
    Senior AI Governance Strategy Lead

    Senior AI Governance Strategy Lead

    Gartner • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein
    A leading research and advisory company seeks a Sr Director Analyst with expertise in AI Governance.The successful candidate will deliver actionable insights and research to assist data and analyti...Voir plus
    Dernière mise à jour : il y a 5 jours • Offre sponsorisée
    Senior Software Engineer, Cloud-Native & AI / ML

    Senior Software Engineer, Cloud-Native & AI / ML

    Telesat • Ottawa H2B, ON, Canada
    Temps plein
    A global satellite communications provider in Ottawa is seeking a seasoned software developer to enhance its Lightspeed System Operations software applications. The ideal candidate will have at leas...Voir plus
    Dernière mise à jour : il y a 5 jours • Offre sponsorisée
    Remote Data Architect - Modernize Enterprise Data

    Remote Data Architect - Modernize Enterprise Data

    Orangutech • Ottawa H2B, ON, Canada
    Télétravail
    Temps partiel
    A public service organization is seeking an experienced Database Architect for a future opportunity.This role focuses on leading assessments and modernizing the enterprise data ecosystem.Candidates...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Senior ASIC Design Engineer for AI / HPC SoCs

    Senior ASIC Design Engineer for AI / HPC SoCs

    Btadesignservices • Ottawa H2B, ON, Canada
    Temps plein
    A leading semiconductor firm located in Ottawa is searching for a Senior ASIC Design Engineer.The role requires a minimum of 8 years in ASIC design with strong skills in RTL logic and lab troublesh...Voir plus
    Dernière mise à jour : il y a 11 jours • Offre sponsorisée
    Senior Software Engineer, AI-Powered Cloud Cost Optimization

    Senior Software Engineer, AI-Powered Cloud Cost Optimization

    Frugal • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein
    A pioneering SaaS startup in Ottawa, ON, seeks a Senior Software Engineer to drive critical platform development and mentor teams. You'll tackle complex challenges from design to deployment while en...Voir plus
    Dernière mise à jour : il y a 3 jours • Offre sponsorisée
    Senior ASIC Design Engineer – AI / HPC SoCs & RTL Expert

    Senior ASIC Design Engineer – AI / HPC SoCs & RTL Expert

    BTA Design Services Inc. • Ottawa H2B, ON, Canada
    Temps plein
    A leading design services firm in Ottawa is seeking a Senior ASIC Design Engineer with over 8 years of experience in ASIC design and complex RTL logic. In this role, you will translate system-level ...Voir plus
    Dernière mise à jour : il y a 6 jours • Offre sponsorisée
    Growth Marketing Lead — AI Platform & PLG Engine

    Growth Marketing Lead — AI Platform & PLG Engine

    Featherless AI • Ottawa H2B, ON, Canada
    Temps plein
    An AI infrastructure company in Ottawa is looking for a Head of Growth Marketing.The ideal candidate will be a strategic leader who can turn organic traffic and analytics into a predictable growth ...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Senior Sales Engineer

    Senior Sales Engineer

    Eutelsat Communications SA • Ottawa H2B, ON, Canada
    Télétravail
    Temps plein
    Be part of a new era in communications, transforming connectivity with Eutelsat – the world’s first GEO-LEO integrated global satellite operator. As a leader in satellite communications, we provide ...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée