Introduction
The Provincial Information Management and Analytics (PIMA) Branch is looking for Data Engineers to join the Analysis and Development area of the Data Administration and Business Intelligence unit (DABI).
As the primary liaison for DABI-related services and functions with PIMA, the Analysis and Development area leads Master Data Management in the provincial data repository.
The area works with source data providers to review metadata before onboarding new datasets, and reviews metadata updates;
creates and facilitates data extracts for internal and external organizations, and is responsible for the development of activities that support data collection, organization, analytics, and distribution.
Conditions of Employment :
- Must be legally entitled to work in Canada
- Must provide a current and satisfactory Criminal Record Check
- Must be able to work on-call or extended hours as required
Qualifications : Essential :
- Post-secondary degree in Information Technology, Computer Science, Computer Engineering or a related field. An equivalent combination of education, training and experience may be considered.
- Experience working as a Data Engineer or performing similar duties.
- Proficiency in creating ETL processes to support data extraction, data transformation, data structures, metadata, dependency and workload management.
- Experience using programming and scripting languages (e.g. C#, Python, Java, T-SQL) and Business Intelligence reporting tools.
- Experience building and optimizing data pipelines and data sets.
- Experience performing analyses on internal and external data to identifying opportunities for data quality improvement.
- Experience applying methodologies in areas such as : design and modeling of databases, data systems, systems analysis, and database technology.
- Excellent technical and non-technical verbal communication skills.
- Excellent technical and non-technical written communication skills.
- Excellent interpersonal skills to support and collaborate with cross-functional teams in a dynamic environment with Agile cultures.
- Strong organizational and time management skills including the ability to respond to changing priorities and meet deadlines.
Desired :
- Experience working within a health data environment.
- Experience working with all areas of the big data ecosystem.
- Experience working with cloud service providers (e.g. AWS or Microsoft Azure)
- Experience creating ETL processes using SSIS (SQL Server Integration Service).
Duties : The Data Engineers will :
- Provide leadership and mentorship to other data engineers;
- Design, build, automate, test, tune, and support : Extraction, Transformation, and Loading (ETL) of data from various sources;
- Create and implement the physical database structure; and
- Construct and implement operational data stores or marts, based on the logical data model.
Forcepoint DLP (Data Loss Prevention) Engineer
Forcepoint DLP (Data Loss Prevention) Engineer. CASB, Data Classification, Data Discovery, encryption, etc. Forcepoint DLP Engineer or Forcepoint NGFW Engineer). This qualified individual will provide engineering, installation, configuration and integration of Forcepoint products. ...
Data Engineer
The area works with source data providers to review metadata before onboarding new datasets, and reviews metadata updates; creates and facilitates data extracts for internal and external organizations, and is responsible for the development of activities that support data collection, organization, a...
Data Engineer (Vertica OR Snowflake & Airflow OR Spark)
On-board NRT data pipeline as per business requirement Performance tuning of bad performing queries and data model redesign. Experience with OLAP databases such as Vertica and or Snowflake. Familiarity with data pipelines that use Airflow and Spark or equivalent tools. Creating Vertica Snowflake dat...
Senior Software Engineer - Data Backend (Remote, Canada)
Work closely with other software engineering teams, product managers and data scientists to identify and use the most relevant consumer and business data. We do! We're the data backend engineers who make these systems work with speed, efficiency, and at scale. We use NoSQL data stores, data warehous...
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -19021
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. You will be ...
Data Engineer
Hands on experience in working with data warehouses and large amount of data. Minimal 5 years hands-on experience on building Data Pipelines. Experience with relational and nosql databases. Experience building external integrations and mapping data from one service in to another. ...
Principal Data Engineer
The successful candidate will be responsible for building data infrastructure and services that operationalizes petabytes of medical imaging data and associated tabular clinical data. Our multi-disciplinary team of data scientists, engineers, clinicians, and business operators is on a mission to hel...
Professional Services Engineers – Mobile Data Network Vancouver
Field Support / PS Engineer, Customer Service Engineer. They are looking for a Professional Services Engineer with about 5 yrs experience. The Professional Services Engineer is a key role in the Professional Services (PS). ...
Senior Data Engineer
We’re looking for a passionate and talented individual with a keen eye for data to join the Data Engineering team at Coursera! Data Engineering plays a crucial role in building a robust and reliable data infrastructure that enables data-driven decision-making, as well as various data analytics and m...
Senior Software Engineer, Data
Collaborate with product managers, data analysts, and machine learning engineers to develop pipelines and ETL tasks in order to facilitate the extraction of insights. You have developed maintainable data pipelines with them. You are experienced in creating automated testing, applying design patterns...