GenAI Engineer, Agentic Flows & Evaluation

Description

& SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.

Meaningful work you’ll be part of

As aGenAI Engineer, Agentic Flows & Evaluation,you’llwork as part of a team of problem solvers, helping to solve business issues, deliver high quality client service and operational efficiency.We are looking for a GenAI Engineer to design and evaluate agentic flows, build test harnesses, andestablishground truth datasets for performance benchmarking. Responsibilities include but are not limited to :

Developagentic flowsusing frameworks likeLangGraph, OpenAI SDK, Google ADK, and MCPS.

Createagent test harnessesfor automated evaluation.

Benchmark and compare different agent frameworks for performance and reliability.

Build andmaintainground truth datasetsfor evaluation.

Collaborate with AI researchers and developers to improve agentic workflows.

Experiences and skills you’ll use to solve

Strong understanding ofLLMs,agent frameworks, and orchestration tools.

Experience withevaluation methodologiesfor AI systems.

ProficiencyinPython,Next.js, and familiarity withLangChain / LangGraphecosystems.

Ability to design scalable and modular testing frameworks.

Knowledge ofOpenAI SDK,Google AI SDK, and integration best practices.

Preferred Certifications :  AI / ML specialization certifications (AWS, Azure, or equivalent).

PwC Canada is committed to cultivating an inclusive, hybrid work environment. Exact expectations for your team can be discussed with your interviewer.

Travel : Occasional for client engagements.

Thisnewly created role reflects our commitment to growth and delivering distinctive value for our clients and stakeholders.

The salary range for this position is $84,700 - $134,700. The posted salary rangerepresentsthe expected hiring range for PwC locations in major citycentres. Given our national recruiting approach, ranges may vary for positions in other locations. At PwC Canada, base salary isdeterminedby your skills, experience,qualificationsand work location.In addition to base salary, eligible employees may have opportunities to participate in variable incentive pay programs which are designed to reward individual and firm-wide achievements. We are committed to offering competitive compensation and adhere to all relevant pay transparency legislation. During the hiring process, our Talent Acquisition team will provide details about our comprehensive total rewards package.

Why you’ll love PwC

We’re inspiring and empowering our people to change the world. Powered by the latest technology, you’ll be a part of diverse teams helping public and private clients build trust and deliver sustained outcomes. This meaningful work, and our continuous development environment, will take your career to the next level. We reward your impact, and support your wellbeing, through a competitive compensation package, inclusive benefits and flexibility programs that will help you thrive in work and life. Learn more about our Application Process and Total Rewards Package at :

PwC Canada acknowledges that we work and live across Turtle Island, on the land that is now known as Canada, which are the lands of the ancestral, treaty and unceded territories of the First Nations, Métis and Inuit Peoples. We recognize the systemic racism, colonialism and oppression that Indigenous Peoples have experienced and still go through, and we commit to allyship and solidarity.

Education

Degrees / Field of Study required : Degrees / Field of Study preferred :

Certifications

Required Skills

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Artificial Intelligence, Big Data, C++ Programming Language, Communication, Complex Data Analysis, Creativity, Data-Driven Decision Making (DIDM), Data Engineering, Data Lake, Data Mining, Data Modeling, Data Pipeline, Data Quality, Data Science, Data Science Algorithms, Data Science Troubleshooting, Data Science Workflows, Deep Learning, Embracing Change, Emotional Regulation, Empathy {+ 18 more}

Desired Languages

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date

We’re committed to providing accommodation throughout the application, interview, and employment process. If you require accommodation to be at your best, please let us know during the application process.The use of artificial intelligence (AI) in recruiting is just getting started, so we know you have questions about how and why we use it. At certain points during our recruiting process, we rely on AI to improve your experience. This could be during resume review or curating personalized job recommendations, asking you clarifying questions via a chatbot or during our interview scheduling to improve your experience. Our use of AI helps ensure we combat bias by evaluating candidates equally and fairly, without seeing identity information, such as your name, or gender for example). AI also helps us better predict successful hires by reviewing all applicants for a role and the relationship between your skills, experience and likely success at PwC Canada. While AI supports parts of our recruitment process, final hiring decisions always involve human review. For more information about our use and protection of your data, please refer to our Privacy Policy ().Nous tenons à répondre à vos besoins tout au long du processus de demande d’emploi, d’entrevue et d’embauche. Si vous avez besoin de mesures d’adaptation pour être parfaitement à l’aise, faites-le-nous savoir à l’étape de la demande d’emploi.L’utilisation de l’intelligence artificielle (IA) dans le domaine du recrutement en est à ses balbutiements. Nous savons que vous pourriez vous demander comment et pourquoi nous y avons recours. À certains stades de notre processus de recrutement, nous comptons sur l’IA pour améliorer votre expérience. Par exemple, pendant l’examen du curriculum vitæ ou l’élaboration d’une liste de recommandations personnalisées, un agent conversationnel pourrait vous demander des précisions ou fixer avec vous un rendez-vous pour l’entrevue. L’IA nous aide à mieux lutter contre les préjugés, car l’évaluation des candidats se fait de façon juste et équitable, sans que les informations d’identification comme le nom ou le sexe soient connues. Elle nous permet également de mieux repérer les bons candidats pour un poste et d’évaluer le lien entre leurs compétences, leur expérience et leurs chances de réussir chez PwC Canada. Bien que l’IA facilite certaines étapes de notre processus de recrutement, les décisions finales d’embauche sont toujours prises par des personnes. Pour en savoir plus sur l’utilisation et la protection de vos données personnelles, consultez notre politique sur la protection des renseignements confidentiels ().