Lead Data Engineer, (Global Security)

Job Description

What is the Opportunity?

The Pharos Data & Analytics team within RBC Global Security is looking for a Lead Data Engineer to join our mission of turning security data into actionable intelligence. We build and operate the data platform that powers security decision‑making across the enterprise — ingesting data from dozens of sources, transforming it at scale, and delivering curated datasets and metrics to security leaders.

As our Lead Data Engineer, you will own the technical direction of a squad of data engineers, drive delivery of high‑impact data products, and partner with stakeholders to shape our roadmap. You'll work hands‑on with code daily while elevating the team through mentorship, design reviews, and engineering best practices.

What You Will Do

Lead & Deliver

• Lead a squad of data engineers — set technical direction, unblock the team, and drive sprint delivery.
• Partner with product owners and security stakeholders to prioritize the backlog based on business value and team capacity.
• Own end‑to‑end delivery of data products from design through production support.

Build & Architect

• Design and implement scalable batch and streaming pipelines using PySpark, Databricks, and Delta Lake.
• Develop and maintain ETL/ELT workflows ingesting from REST APIs, S3, Kafka, and enterprise databases.
• Define data models, enforce schema standards, and ensure data quality.
• Optimize pipeline performance, reliability, and cost efficiency.

Elevate & Improve

• Champion engineering best practices: code review, testing, CI/CD, observability, and documentation.
• Drive DataOps maturity — monitoring, alerting, incident response, and automated data quality checks.
• Stay current on emerging data technologies and bring pragmatic innovation to the team.
• Foster a collaborative, inclusive, and high‑trust team culture.

Must Have

• 6+ years hands‑on data engineering experience and 2+ years leading or technically mentoring a team.
• Strong proficiency in Python and PySpark — you write production code daily.
• Exceptional skill in Python API development and software engineering (design patterns, testing, packaging, production‑grade code).
• Deep experience with Databricks (notebooks, jobs, Unity Catalog, Delta Lake).
• Solid SQL skills — writing, optimizing, and debugging complex queries.
• Experience designing and operating data pipelines at scale (batch and/or streaming).
• Familiarity with cloud platforms (Azure preferred; AWS acceptable).
• Experience with Terraform for infrastructure‑as‑code and resource deployment to manage cloud infrastructure.
• Experience with Airflow for workflow orchestration and pipeline scheduling.
• Track record of following DevOps/Agile best practices (CI/CD, Git, Jira).
• Excellent communication skills — able to translate technical concepts for non‑technical stakeholders.

Nice to Have

• Experience with Azure Data services, OpenShift, S3 (on‑prem or cloud).
• Exposure to ML/AI concepts and MLOps workflows.
• Experience building observability/monitoring dashboards (Grafana, Databricks dashboards).
• Background in cybersecurity data (vulnerability management, SAST/DAST, asset inventory, etc.).

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosperous. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
• Leaders who support your development through coaching and managing opportunities
• Ability to make a difference and lasting impact
• Work in a dynamic, collaborative, progressive, and high‑performing team
• A world‑class training program in financial services
• Opportunities to do challenging work
• Opportunities to take on progressively greater accountabilities
• Opportunities to building close relationships with clients
• Access to a variety of job opportunities across business and geographies

#LI-Post

#TechPJ

Job Skills

Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis

Additional Job Details

Address: 16 YORK ST:TORONTO

City: Toronto

Country: Canada

Work hours/week: 37.5

Employment Type: Full time

#J-18808-Ljbffr