Senior Data Developer/engineer

Status : Regular Full time

Working Conditions : Hybrid Minimum 3 days in the office

Education Level : Bachelor’s degree in computer science, computer / software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.

Location : Toronto, ON

Shifts(s) : Days

Travel : 10%

Deadline to Apply : October, 16th, 2023

Electrify your career and help build a brighter tomorrow.

Every generation has a challenge that defines them. At OPG, we are calling on all innovators, disruptors, thought leaders and change-makers.

Join us to electrify life in one generation and build a sustainable future powered by our electricity, our ideas, and our people.

Join OPG and make history.

Whether you work in the skilled trades or are a business professional, a career at OPG is an opportunity to electrify your life on and off the job.

ACCOMMODATIONS

OPG is committed to fostering an inclusive, equitable, and accessible environment where all employees feel valued, respected, and supported.

If you require accommodation during the application or interview process, please advise us as soon as possible so appropriate arrangements can be made.

If you require information in a format that is accessible to you, please contact [email protected]

NEW CAMPUS : In late 2024, OPG is establishing our new campus at 1908 Colonel Sam Drive, Oshawa, Ontario. The new campus will provide a cutting-edge work environment that fosters collaboration and innovation.

JOB OVERVIEW

Ontario Power Generation (OPG) is looking for a dynamic, strategic and results-driven professional to join our team in the role of a Senior Data Developer / Engineer

Reporting to the Senior Manager, Enterprise Data Lake Deployment, the Senior Data Developer is responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.

You will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation.

You will employ best practice in development, security, accessibility and design to achieve the highest quality of service for our customers.

This is an exciting opportunity to work in an environment where you will contribute to OPG’s public outreach, engagement and education efforts as part of the company’s commitment to growing its social license.

KEY ACCOUNTABILITIES

• Design, build and productionize modular and scalable data ELT / ETL pipelines and data infrastructure leveraging the wide range of data sources across the organization
• Implement curated common data models that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect
• Work closely with infrastructure and cyber teams to ensure data is secure in transit and at rest
• Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle
• Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods
• Troubleshoot issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity
• Collaborate with business analysts, data scientists, data engineers, data analysts and solution architects to develop data pipelines to feed our data marketplace
• Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI
• Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban / SCRUM toolsets
• Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use
• Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats
• Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base
• Implement orchestration of data pipeline execution to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use
• Create tooling to help with day to day tasks, and reduce toil via automation wherever possible
• Work with Continuous Integration / Continuous Delivery and DevOps pipelines to automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning
• Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis
• Implement and manage appropriate access to data products via role-based access control
• Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases
• Participate in peer code review sessions, and approve non-production pull requests
• Other duties as required

EDUCATION

Bachelor’s degree in computer science, computer / software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.

QUALIFICATIONS

• 4 + years of experience in data modeling, data warehouse design and data solution architecture in a Big Data environment as a Data Engineer
• Experience with integrating structured and unstructured data across various platforms and sources.
• Knowledge of content fragmentation, partitioning, query parallelism, and query execution plans.
• Experience with implementing event-driven (pub / sub), near-real-time, or streaming data solutions. Strong knowledge with programming methodologies (source / version control, continuous integration / continuous delivery, automated testing, quality assurance) and agile development methodologies.
• In depth knowledge of and experience with relational, SQL and NoSQL databases. Fluency with SQL, Python, and Spark / PySpark is required.
• Excellent interpersonal, communication, and presentation skills, including formal report writing experience.
• Must have a strong customer service mindset and the ability to project that attitude to internal stakeholders within other lines of business.
• Ability to work effectively and efficiently in a flexible hybrid office environment.

The successful candidate will exhibit uncompromising integrity and commitment to upholding corporate values, and the OPG Code of Business Conduct.

What Makes a Career at OPG Different?

As Ontario’s largest clean energy generator, we’re building, expanding, and innovating the equipment and technology that keeps Ontario powered with clean, reliable energy.

At OPG, our values are our strengths. They are fundamental truths about our organization that don’t change :

Safety it’s our business

Integrity always lead with integrity

Excellence never satisfied with good enough

Inclusion working together for powerful outcomes

Innovation - creativity accelerates possibility

Here's why OPG might just be the ideal workplace for you :

• Exceptional range of opportunities province-wide
• Long-term career growth and development opportunities
• Electricity is vital to the province and OPG’s clean electricity is helping decarbonize other sectors.

Our promise to you :

• We care about the safety and the well-being of our employees. It is our utmost priority.
• A supportive work environment where you can be your best every day.
• Opportunities to stretch and develop.
• Offer different ways for you to give back to communities where we operate.
• Partner with Indigenous communities and support local businesses.
• We support employment equity, diversity and inclusion.

Are you ready to start a career that has the power to electrify life on and off the job? Apply now.