GenAI Engineer, Agentic Flows & Evaluation

Line of Service

Advisory

Industry / Sector

Not Applicable

Specialism

Analytics

Management Level

Senior Associate

Job Description & Summary

At PwC our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights enabling informed decision-making and driving business growth.

Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models conducting statistical analysis and creating data visualisations to solve complex business problems.

Meaningful work youll be part of

As a GenAI Engineer Agentic Flows & Evaluation youll work as part of a team of problem solvers helping to solve business issues deliver high quality client service and operational efficiency. We are looking for a GenAI Engineer to design and evaluate agentic flows build test harnesses and establish ground truth datasets for performance benchmarking. Responsibilities include but are not limited to :

Develop agentic flows using frameworks like LangGraph OpenAI SDK Google ADK and MCPS.

Create agent test harnesses for automated evaluation.

Benchmark and compare different agent frameworks for performance and reliability.

Build and maintain ground truth datasets for evaluation.

Collaborate with AI researchers and developers to improve agentic workflows.

Experiences and skills youll use to solve

Strong understanding of LLMs agent frameworks and orchestration tools.

Experience with evaluation methodologies for AI systems.

Proficiency in Python and familiarity with LangChain / LangGraph ecosystems.

Ability to design scalable and modular testing frameworks.

Knowledge of OpenAI SDK Google AI SDK and integration best practices.

Preferred Certifications : AI / ML specialization certifications (AWS Azure or equivalent).

PwC Canadaiscommitted to cultivating an inclusive hybrid work environment. Exact expectations for your team can be discussed with your interviewer.

Travel : Occasional for client engagements.

This newly created role reflects our commitment to growth and delivering distinctive value for our clients and stakeholders .

The salary range for this position is $84700 - $134700 . The posted salary range represents the expected hiring range for PwC locations in major city centres . Given our national recruiting approach ranges may vary for positions in other locations. At PwC Canada base salary is determined by your skills experience qualifications and work location. In addition to base salary eligible employees may have opportunities to participate in variable incentive pay programs which are designed to reward individual and firm-wide achievements. We are committed to offering competitive compensation and adhere to all relevant pay transparency legislation. During the hiring process our Talent Acquisition team will provide details about our comprehensive total rewards package.

Why youll love PwC

Were youll be a part ofdiverseteams helping public and private clients build trust and deliver sustained outcomes. This meaningful work and our continuous development environment will take your career to the next level. We reward your impact and support your wellbeing through a competitive compensation package inclusive benefits and flexibility programs that will help you thrive in work and more aboutourApplication Process andTotal Rewards Package at : Canada acknowledges that we work and live across Turtle Island on the land that is now known as Canada which are the lands of the ancestral treaty and unceded territories of the First Nations Métis and Inuit Peoples. We recognize the systemic racism colonialism and oppression that Indigenous Peoples have experienced and still go through and we commit to allyship and solidarity.

Education (if blank degree and / or field of study not specified)

Degrees / Field of Study required :

Degrees / Field of Study preferred :

Certifications (if blank certifications not specified)

Required Skills

Optional Skills

Accepting Feedback Accepting Feedback Active Listening Analytical Thinking Artificial Intelligence Big Data C Programming Language Communication Complex Data Analysis Creativity Data-Driven Decision Making (DIDM) Data Engineering Data Lake Data Mining Data Modeling Data Pipeline Data Quality Data Science Data Science Algorithms Data Science Troubleshooting Data Science Workflows Deep Learning Embracing Change Emotional Regulation Empathy 18 more

Desired Languages (If blank desired languages not specified)

Travel Requirements

Not Specified

Available for Work Visa Sponsorship

No

Government Clearance Required

No

Job Posting End Date

Were committed to providing accommodation throughout the application interview and employment process. If you require accommodation to be at your best please let us know during the application process.

The use of artificial intelligence (AI) in recruiting is just getting started so we know you have questions about how and why we use it. At certain points during our recruiting process we rely on AI to improve your experience. This could be during resume review or curating personalized job recommendations asking you clarifying questions via a chatbot or during our interview scheduling to improve your experience. Our use of AI helps ensure we combat bias by evaluating candidates equally and fairly without seeing identity information such as your name or gender for example). AI also helps us better predict successful hires by reviewing all applicants for a role and the relationship between your skills experience and likely success at PwC Canada. While AI supports parts of our recruitment process final hiring decisions always involve human review. For more information about our use and protection of your data please refer to our Privacy Policy ( tenons à répondre à vos besoins tout au long du processus de demande demploi dentrevue et dembauche. Si vous avez besoin de mesures dadaptation pour être parfaitement à laise faites-le-nous savoir à létape de la demande demploi.

Lutilisation de lintelligence artificielle (IA) dans le domaine du recrutement en est à ses balbutiements. Nous savons que vous pourriez vous demander comment et pourquoi nous y avons recours. À certains stades de notre processus de recrutement nous comptons sur lIA pour améliorer votre expérience. Par exemple pendant lexamen du curriculum vitæ ou lélaboration dune liste de recommandations personnalisées un agent conversationnel pourrait vous demander des précisions ou fixer avec vous un rendez-vous pour lentrevue. LIA nous aide à mieux lutter contre les préjugés car lévaluation des candidats se fait de façon juste et équitable sans que les informations didentification comme le nom ou le sexe soient connues. Elle nous permet également de mieux repérer les bons candidats pour un poste et dévaluer le lien entre leurs compétences leur expérience et leurs chances de réussir chez PwC Canada. Bien que lIA facilite certaines étapes de notre processus de recrutement les décisions finales dembauche sont toujours prises par des personnes. Pour en savoir plus sur lutilisation et la protection de vos données personnelles consultez notre politique sur la protection des renseignements confidentiels ( Experience :

Unclear Seniority

Key Skills

ASP.NET,Health Education,Fashion Designing,Fiber,Investigation

Employment Type : Full-Time

Experience : years

Vacancy : 1