Data Engineer

Manitoba Government
Winnipeg MB
$74K-$98.8K a year
Full-time

Introduction

The Provincial Information Management and Analytics (PIMA) Branch is looking for Data Engineers to join the Analysis and Development area of the Data Administration and Business Intelligence unit (DABI).

As the primary liaison for DABI-related services and functions with PIMA, the Analysis and Development area leads Master Data Management in the provincial data repository.

The area works with source data providers to review metadata before onboarding new datasets, and reviews metadata updates;

creates and facilitates data extracts for internal and external organizations, and is responsible for the development of activities that support data collection, organization, analytics, and distribution.

Conditions of Employment :

  • Must be legally entitled to work in Canada
  • Must provide a current and satisfactory Criminal Record Check
  • Must be able to work on-call or extended hours as required

Qualifications : Essential :

  • Post-secondary degree in Information Technology, Computer Science, Computer Engineering or a related field. An equivalent combination of education, training and experience may be considered.
  • Experience working as a Data Engineer or performing similar duties.
  • Proficiency in creating ETL processes to support data extraction, data transformation, data structures, metadata, dependency and workload management.
  • Experience using programming and scripting languages (e.g. C#, Python, Java, T-SQL) and Business Intelligence reporting tools.
  • Experience building and optimizing data pipelines and data sets.
  • Experience performing analyses on internal and external data to identifying opportunities for data quality improvement.
  • Experience applying methodologies in areas such as : design and modeling of databases, data systems, systems analysis, and database technology.
  • Excellent technical and non-technical verbal communication skills.
  • Excellent technical and non-technical written communication skills.
  • Excellent interpersonal skills to support and collaborate with cross-functional teams in a dynamic environment with Agile cultures.
  • Strong organizational and time management skills including the ability to respond to changing priorities and meet deadlines.

Desired :

  • Experience working within a health data environment.
  • Experience working with all areas of the big data ecosystem.
  • Experience working with cloud service providers (e.g. AWS or Microsoft Azure)
  • Experience creating ETL processes using SSIS (SQL Server Integration Service).

Duties : The Data Engineers will :

  • Provide leadership and mentorship to other data engineers;
  • Design, build, automate, test, tune, and support : Extraction, Transformation, and Loading (ETL) of data from various sources;
  • Create and implement the physical database structure; and
  • Construct and implement operational data stores or marts, based on the logical data model.
  • 30+ days ago
Related jobs
Promoted
Outlier
Winnipeg, Manitoba

Are you an experienced software engineer who would like to lend your coding expertise to train AI models?. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. W...

Shiftsmart
Canada
Remote

Data Architecture: Design and develop large-scale data systems, including databases, data warehouses, and big data platforms, with a strong focus on data governance and compliance requirements. Your expertise in software engineering, data systems, and data governance will play a critical role in bui...

CB Canada
Canada

Engineering background (data pipeline, data ingestion, data warehousing, data analytics). Software Engineer (Back-end/ Data). The Select Group is seeking a Software Engineer (Back-end/Data) for their top telecommunication client. For this role, the Engineer will join a team that manages the data lak...

StackAdapt
Canada

We're seeking a Staff Software Engineer to help lead our growing backend engineering team. Integrate data into StackAdapt’s Customer Data Platform (CDP). Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Architect scal...

KPMG
Canada, Canada

Hands on experience with data processing and analytics using Azure Data Factory, Azure Synapse, Azure Data Lake or Azure Databricks is a plus. Contribute to the design and development of enterprise-level data solutions, including data warehouses, data lakes, and real-time analytics platforms, using ...

Cloudbeds
Canada
Remote

Proven experience as a big data engineer or a similar role, with a deep understanding of big data technologies, frameworks, and best practices. Building and maintaining data infrastructure, including data lakes, data warehouses, and real-time streaming platforms. Developing and optimizing data pipel...

Aritzia
Canada, Canada

This is a unique opportunity to join the Analytics Engineering Department, where you will transform raw data in a modern platform and create models that empower self-serve analysis, reporting, and data science. As the (Senior) Analytics Engineer, you will support and enable the business, apply data ...

StackAdapt
Canada

Working with large data sets and various databases including Aerospike, Elasticsearch, Redis, ScyllaDB, Redshift, TiDB, MariaDB. Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Very strong problem solving skills in d...

S.i. Systems
Winnipeg, Manitoba

Staff Software Engineer with Java (Springboot) to build out features on a Master Data Management product from start to finish. ...

Doximity
Remote, Canada
Remote

Collaborate with product managers, data analysts, and machine learning engineers to develop pipelines and ETL tasks in order to facilitate the extraction of insights. You have developed maintainable data pipelines with them. You are experienced in creating automated testing, applying design patterns...