Talent.com
AI Data Engineer
AI Data EngineerVeeva Systems • Ottawa, ON, CA
AI Data Engineer

AI Data Engineer

Veeva Systems • Ottawa, ON, CA
19 days ago
Job type
  • Full-time
Job description

Join to apply for the AI Data Engineer role at Veeva Systems.

Get AI-powered advice on this job and more exclusive features.

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth potential ahead.

At the heart of Veeva are our values : Do the Right Thing, Customer Success, Employee Success, and Speed. We're not just any public company – we made history in 2021 by becoming a public benefit corporation (PBC), legally bound to balancing the interests of customers, employees, society, and investors.

As a Work Anywhere company, we support your flexibility to work from home or in the office, so you can thrive in your ideal environment.

Join us in transforming the life sciences industry, committed to making a positive impact on its customers, employees, and communities.

The Role

This role is responsible for ensuring the reliability, accuracy, and safety of our Veeva AI Agents through rigorous evaluation and systematic validation methodologies. We're looking for experienced candidates with :

  • A meticulous, critical, and curious mindset with a dedication to product quality in a rapidly evolving technological domain
  • Exceptional analytical and systematic problem‑solving capabilities
  • Excellent ability to communicate technical findings to both engineering and product management audiences
  • Ability to learn application areas quickly

Thrive in our Work Anywhere environment : We support your flexibility to work remotely or in the office within Canada or the US, ensuring seamless collaboration within your product team's time zone.

What You’ll Do

  • Evaluation Strategy & Planning : Define and establish comprehensive evaluation strategies for new AI Agents. Prioritize the integrity and coverage of test data sets to reflect real‑world usage and potential failure modes.
  • LLM Output Integrity Assessment : Programmatically and manually evaluate the quality of LLM‑generated content against predefined metrics (e.g., factual accuracy, contextual relevance, coherence, and safety standards).
  • Creating High‑Fidelity Datasets : Design, curate, and generate diverse, high‑quality test data sets, including challenging prompts and scenarios. Evaluate LLM outputs to proactively identify system biases, unsafe content, hallucinations, and critical edge cases.
  • Automation of Evaluation Pipelines : Develop, implement, and maintain scalable automated evaluations to ensure efficient, continuous validation of agent behavior and prevent regressions with new features and model updates.
  • Root Cause Analysis : Understand model behaviors and assist in the trace and root‑cause analysis of identified defects or performance degradations.
  • Reporting & Performance Metrics : Clearly document, track, and communicate performance metrics, validation results, and bug status to the broader development and product teams.
  • Requirements

  • Data Integrity & Validation : A strong, specialized understanding of data quality principles, including methods for validating datasets against bias, integrity concerns, and quality standards. Ability to craft diverse and adversarial test data to uncover AI edge cases.
  • Prompt Engineering & Model Expertise : Demonstrated skill in advanced prompt engineering techniques to create evaluation scenarios that test the AI's reasoning, action planning, and adherence to system instructions. Deep knowledge of LLM common failure modes (hallucination, incoherence, jailbreaking).
  • Automated Evaluation Implementation : 5+ years of experience designing and deploying automated evaluation pipelines to assess complex, agentic AI behaviors. Familiarity with quality metrics such as task success rate, semantic similarity, and sentiment analysis for output measurement.
  • Debugging Agentic Systems : Must be comfortable with the specific challenges of debugging agentic systems, including tracing and interpreting an agent's internal reasoning, tool use, and action sequence to pinpoint failure points.
  • Programming & Frameworks : 5+ years of experience using Python to develop custom evaluation frameworks, writing scripts, and integrating pipelines with CI / CD systems. Familiarity with standard test automation tools (e.g., Pytest, modern web automation tools).
  • Bachelor's degree in Data Science, Machine Learning, Computer Science, or a related field, with experience in Gen AI / LLMs.
  • High work ethic. Veeva is a hard‑working company.
  • High integrity and honesty. Veeva is a PBC and a “do the right thing” company. We expect that from all employees.
  • Applicants must have the unrestricted right to work in the United States or Canada. Veeva will not provide sponsorship at this time.
  • Learn More

  • Engineer Perspective : 3 Reasons to Consider Veeva
  • Engineering at Veeva
  • Perks & Benefits

  • Medical, dental, vision, and basic life insurance
  • PTO and company‑paid holidays
  • Retirement programs
  • 1% charitable giving program
  • Compensation

  • Base pay : $85,000 - $225,000 CAD
  • The salary range listed here has been provided to comply with local regulations and represents a potential base salary range for this role. Please note that actual salaries may vary within the range above or below, depending on experience and location. We look at compensation for each individual and base our offer on your unique qualifications, experience, and expected contributions. This position may also be eligible for other types of compensation in addition to base salary, such as variable bonus and / or stock bonus.
  • Veeva’s headquarters is located in the San Francisco Bay Area with offices in more than 15 countries around the world.

    Veeva is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity or expression, religion, national origin or ancestry, age, disability, marital status, pregnancy, protected veteran status, protected genetic information, political affiliation, or any other characteristics protected by local laws, regulations, or ordinances. If you need assistance or accommodation due to a disability or special need when applying for a role or in our recruitment process, please contact us at talent_accommodations@veeva.com.

    Referrals increase your chances of interviewing at Veeva Systems by 2x.

    #J-18808-Ljbffr

    Create a job alert for this search

    Engineer Ai • Ottawa, ON, CA

    Similar jobs
    AI Principal Software Engineer - US SaaS startup | Remote

    AI Principal Software Engineer - US SaaS startup | Remote

    Atomic HR • Ottawa H2B, ON, Canada
    Remote
    Full-time
    We connect talented tech professionals in Latin America and Canada with remote career opportunities at innovative startups worldwide. We specialize in finding roles that align with your skills, expe...Show more
    Last updated: 2 days ago • Promoted
    Software Engineer II - AI / ML for Personalization & Search

    Software Engineer II - AI / ML for Personalization & Search

    CNN • Ottawa H2B, ON, Canada
    Full-time
    A leading broadcasting and media company in Ontario is seeking a Software Developer II for AI / ML products.You will collaborate with engineers to create innovative solutions, focusing on machine lea...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI & Cloud Software Engineer

    Senior AI & Cloud Software Engineer

    Export Development Canada | Exportation et développement Canada • Ottawa H2B, ON, Canada
    Remote
    Full-time
    A financial services organization based in Ottawa seeks a Software Engineer or Senior Software & AI Engineer to join their Digital Delivery Marketing and Architects team. This role involves designin...Show more
    Last updated: 5 days ago • Promoted
    Relocate to Malta Data Engineer (Consulting / Big 4)

    Relocate to Malta Data Engineer (Consulting / Big 4)

    Black Pen Recruitment • Ottawa, ON, Canada
    Full-time +1
    Our client is a Microsoft Gold Partner and leader in Microsoft software implementations for medium to large organisations, providing their clients with the ability to keep up with the ever-changing...Show more
    Last updated: 30+ days ago • Promoted
    Python ETL Developer / Data Engineer - Remote

    Python ETL Developer / Data Engineer - Remote

    ipvisibility • Ottawa, ON, Canada
    Remote
    Full-time
    Reviewing, designing, developing ETL jobs to ingest data into Data Lake, load data to data marts;.Parse unstructured data, semi structured data such XML etc. Design and develop efficient Mapping and...Show more
    Last updated: 30+ days ago • Promoted
    Cloud & AI Solutions Engineer : AI Apps (Hybrid)

    Cloud & AI Solutions Engineer : AI Apps (Hybrid)

    Microsoft • Ottawa
    Full-time
    A leading tech company seeks a Cloud & AI Solution Engineer to help enterprise customers unlock AI potential.This role demands strong technical consulting skills and involves driving technical sale...Show more
    Last updated: 2 days ago • Promoted
    AI-Powered Data Architect for Scalable Data Lakes

    AI-Powered Data Architect for Scalable Data Lakes

    Ciena • Ottawa H2B, ON, Canada
    Full-time
    A global leader in high-speed connectivity is seeking a Data Architect to join their Digital Asset Management team in Ottawa, Canada. The role involves designing data architectures, collaborating wi...Show more
    Last updated: 30+ days ago • Promoted
    System Architect — AI / ML Data Center Optics

    System Architect — AI / ML Data Center Optics

    Lumentum • Ottawa H2B, ON, Canada
    Full-time
    A leading technology company in Ottawa is seeking a System Architect to drive product design and development for cutting-edge Optical Circuit Switch products. The role requires 10+ years of product ...Show more
    Last updated: 30+ days ago • Promoted
    Palantir Data Engineer

    Palantir Data Engineer

    Quality IT Resourcing • ottawa, on, ca
    Full-time
    Palantir Data Engineer / Analytics Specialist.There is a growing global demand for professionals with deep expertise in Palantir platforms, particularly within government, defense, and large enterp...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Solink • Ottawa
    Full-time +1
    This range is provided by Solink.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Location : Ottawa, ON | Hybrid (Eastern Time, within Canada).Rep...Show more
    Last updated: 10 hours ago • Promoted • New!
    Sr Director, Analyst - AI Platforms (Remote : Canada / Europe)

    Sr Director, Analyst - AI Platforms (Remote : Canada / Europe)

    Gartner • Ottawa H2B, ON, Canada
    Remote
    Full-time
    Sr Director, Analyst - AI Platforms (Remote : Canada / Europe).Join Gartner as a Senior Director in the Business and Technology Insights division. You will create actionable insights for executive lea...Show more
    Last updated: 30+ days ago • Promoted
    Data Scientist : Power BI & Analytics Leader

    Data Scientist : Power BI & Analytics Leader

    BDO Canada • Ottawa H2B, ON, Canada
    Full-time
    A leading consulting firm in Ottawa is seeking a Data Scientist to transform data into actionable insights.Responsibilities include dashboard development, data modeling, and predictive analytics.Th...Show more
    Last updated: 30+ days ago • Promoted
    AI & Automation Associate

    AI & Automation Associate

    CLV Group • Gloucester, ON, Canada
    Full-time
    CLV Group is a premier Canadian real estate firm specializing in the acquisition, development, and management of high-quality real estate assets. We deliver exceptional returns by aligning strategic...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer, AI Solutions ( 12 months Contract)

    Senior Data Engineer, AI Solutions ( 12 months Contract)

    Kinaxis • Ottawa
    Full-time +1
    Senior Data Engineer, AI Solutions (12 months Contract).Be among the first 25 applicants.Elevate your career journey by embracing a new challenge with Kinaxis. We are experts in tech, but it’s reall...Show more
    Last updated: 10 days ago • Promoted
    Data Analytics Engineer - Hybrid

    Data Analytics Engineer - Hybrid

    Ribbon Communications • Ottawa
    Full-time
    JOB TITLE Data Analytics Engineer – Ribbon Analytics (Full Time).Ribbon Communications is a global leader in real-time communications, transforming networks to secure IP and cloud-based architec...Show more
    Last updated: 30+ days ago • Promoted
    CTO, Canada Public Sector — AI & Cloud Innovator

    CTO, Canada Public Sector — AI & Cloud Innovator

    ServiceNow • Ottawa H2B, ON, Canada
    Remote
    Full-time
    A leading technology company is seeking a Chief Technology Officer for the Canadian Public Sector.This pivotal role requires a strategic leader with 10+ years in technology leadership, strong skill...Show more
    Last updated: 30+ days ago • Promoted
    Growth Marketing Lead — AI Platform & PLG Engine

    Growth Marketing Lead — AI Platform & PLG Engine

    Featherless AI • Ottawa H2B, ON, Canada
    Full-time
    An AI infrastructure company in Ottawa is looking for a Head of Growth Marketing.The ideal candidate will be a strategic leader who can turn organic traffic and analytics into a predictable growth ...Show more
    Last updated: 24 days ago • Promoted
    Remote BI Architect : Data Warehouse & Analytics Solutions

    Remote BI Architect : Data Warehouse & Analytics Solutions

    ROSS • Ottawa H2B, ON, Canada
    Remote
    Full-time +1
    A leading business intelligence firm is seeking an Intermediate or Senior Technical Consultant to architect, design, and develop BI applications for clients. The ideal candidate will have at least 3...Show more
    Last updated: 10 hours ago • Promoted • New!