Senior Cloud Data Engineer

Job Description

Summary

Reporting to the Cloud Data Engineer Manager, the Senior Cloud Data Engineer is responsible for the design, development and maintenance of the PHC organization's data infrastructure, including their databases, warehouses, and pipelines, as well as ingesting, transforming, delivering, and sharing data for analysis and providing a robust foundation for data analytics, to support operational and strategic decisions-making at PHC. As a member of the Cloud Data Engineering sub-team within Data Analytics, creates and prepares data required for modern BI solutions, implement automated methods to improve data reliability and quality, gather requirements from the various business and analytics teams to build the data models and cloud-native, scalable and sustainable data pipelines and workflows within PHC local Analytics Data Hub and the shared PHC / VCH regional Analytics data platforms.

The senior data engineer will have extensive background and experience in data modeling and building traditional and distributed cloud-hosted data pipelines to help guide and explore new grounds in adopting new tools to improve PHC's data processing process and infrastructure.

The position works in close collaboration with other members of the Data Analytics teams, the Senior Data Solutions Architect, Data Scientists, and technical teams, including members of PHSA IMITS and Emerging technology teams, management, and key stakeholders to understand data challenges and identify solutions.

The Senior Cloud Data Engineer will stay apprised of current trends and research on all aspects of dimensional modeling, optimization processes, data engineering and advanced analytics techniques and works in collaboration with provincial and national colleagues.

Qualifications / Skills and Education

Education

Masters' Degree in Computer Science, Applied Mathematics, Data Science, Software Engineering, or other related technical discipline is required plus at least five (5) years' experience working as a Data Engineer, Software Developer, Business Intelligence Engineer or Data Scientist with experience in Cloud platform, manipulating, processing, and extracting value from large datasets. Cloud certificates related to AWS or Azure preferred. Experience with healthcare analytics is an asset.

Skills and Abilities

• Demonstrated strength in data modeling, ETL development, and data warehousing with solid knowledge of various industry standards such as dimensional modeling, and star schemas etc.
• Demonstrated ability to build and optimize ‘big data' data pipelines, architectures and data sets and computing tools such as Spark, MySQL, Azure, AWS, etc.
• Demonstrated knowledge of methods and techniques involved in Advanced Analytics, data mining, statistics, and optimization (including neural networks, reinforcement learning, and adversarial learning).
• Coding proficiency in at least one modern programming language (Python, Java, etc.).
• Demonstrated proficiency working with both relational (SQL) and non-relational databases (NoSQL).
• Demonstrated understanding of data privacy, security and related tools such as anonymization and encryption.
• Excellent oral and written communication skills and ability to clearly and fluently translate technical findings to non-technical partners and to communicate to multiple audiences using data storytelling and through graphics.
• Demonstrated ability to work collaboratively in an interdisciplinary environment and to develop recommendations using facilitation and consensus building.
• Strong analytical, critical thinking, and evaluation skills to discern and help solve the important problems facing health care, to identify new ways to leverage our data, and to direct efforts in the right direction.

Duties and Responsibilities

1. Designs, develops and supports data pipelines, warehouses and reporting systems to address business operations and pressing operational and clinical challenges within the organization.

2. Migrates and moves Data & Analytics platforms and applications to the Azure cloud environment.

3. Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies. Re-designs infrastructure for greater scalability.

4. Assembles large, complex data sets that meet functional / non-functional business requirements. Creates data tools for the Advanced Modeling and Optimization team to assist them in building and optimizing our product into an innovative industry leader.

5. Identifies, designs, and implements internal process improvements including establishing standards for development processes and technical requirements; automating manual processes; optimizing data delivery, etc. Develops and ensures compliance for data management processes, policies and standards. Implements and enforces controls to maintain data availability and quality.

6. Recognizes and adopts best practices in data integrity, test design, analysis, validation, and documentation. Tunes application and query performance using profiling tools and SQL.

7. Researches innovative solutions, develops new concepts, and implements proof-of-concept prototypes by applying expertise in data engineering, advanced analytics, process modeling, and optimization tools and techniques.

8. Works in close collaboration with other members of the Data Analytics and Health Informatics teams to develop and implement innovative solutions that address pressing operational and clinical challenges within the organization.

9. Works closely with clinical and management teams across PHC to strategize, develop, and implement advanced modelling projects that translate into improved quality of care, clinical outcomes, reduced costs, temporal efficiencies, and process improvements.

10. Works with stakeholders including the Executive, and Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

11. Migrates and moves Data & Analytics platforms and applications to the Azure cloud environment.

12. Identifies, cleans, and integrates large sets of structured and unstructured datasets from disparate sources for use in machine learning (ML) models and products.

13. Establishes standards for development processes and technical requirements. Develops and ensures compliance for data management processes, policies and standards. Implements and enforces controls to maintain data availability and quality.

14. Perform other duties as required.

Vaccination Flag

As per the current Public Health Orders (Long Term Care / Seniors Assisted Living Provincial Health Order and the Health Sector Order), as of October 26, 2021, all employees working for Providence Health Care must be fully vaccinated against COVID-19. Proof of vaccination status will be required.