Data Engineer

• POSITION PURPOSE Reporting to the Program Manager, Transportation Data Management & Business Intelligence, is responsible for full lifecycle design and development, implementation of new data platforms / solutions, production support, performance tuning of reporting environments including Extract Transform Load (ETL) batch and streaming data processes and for supporting the integration of those systems with other applications;
• works with internal and external stakeholders, Corporate IT and Data Analytics and Visualization Branch, to provide technical leadership in the analysis, design, implementation, management and support of data-driven business systems following various departmental technology plans and utilizing approved IT solutions;
• designs and builds end-to-end solutions that enable business stakeholders to self-serve their business intelligence needs;
• consults with stakeholders to steer any new or enhancement related requirements to ensure stakeholder business needs are met;

develops solution alternatives used to ingest and process data; works with multiple cross functional teams within IT and the business on developing solutions.

CORPORATE INFORMATION TECHNOLOGY GOVERNANCE

Departmental information technology functions work in close collaboration with Corporate Information Technology Services (ITS);

consistent with the Information Technology vision and strategy; supporting the development and implementation of Information Technology initiatives, programs, processes, policies, and protocols.

Corporate ITS provides strategic ITS planning, direction and leadership across the Region.

MAJOR RESPONSIBILITIES

• Works with ITS and vendors to design, develop and provide solutions to support the data needs of applications, analysis and support of the department’s data management initiatives and related Master Data Management (MDM) processes.
• Assists in developing data centric strategy and department roadmap and obtains stakeholders approval.
• Develops department business cases and cost benefit analysis to obtain senior management approval on managing structured, unstructured and disparate source data into target data store(s) / Enterprise Data and Analytics platform.
• Analyzes business requirements, suggests alternative approaches to reporting systems design working in collaboration with data and information architects, and prepares a proof of concept for user consultation.
• Translates complex functional and technical requirements into detailed architecture, designs logical data models, physical databases, and high performing software solutions.
• Designs and builds data ingestion and integration pipelines for large volumes of operations and infrastructure asset temporal data from different sources.
• Manages complex data management and reporting projects and leads project teams, ensuring timely delivery of products and services;

tracks project activities, timelines and project deliverables.

• Assists management in developing RFP, RFQ, and handling departmental purchasing process.
• Liaises with internal staff, providing systems expertise and support; share information regarding initiatives and other best practices with Branch, Department and Corporate staff;
• Works as part of a multi-disciplinary customer support team contributing to strategic plans, implementation plans, and ongoing support of continuous improvement initiatives within Department.
• Performs backup duties of other staff, as assigned.

QUALIFICATIONS

• Successful completion of a University Degree in Computer Science, Computer Engineering, Information Technology, or approved equivalent combination of education and experience.
• Must have experience in working with data modeling and analyzing large volume of data. Fluent in relational database, streaming data processing concepts, knowledge of current data management practices.
• Demonstrated experience in writing complex, highly-optimized SQL queries across large datasets.
• Demonstrated knowledge and experience of software solutions development lifecycles / methodologies agile or other rapid application development methods.
• Experience providing project implementation analysis and support in data management systems, data integrity and security as it relates to environmental business systems.
• Experience in unified data modelling for relational and NOSQL database and physical database design; programming languages ( PL / SQL, Visual Basic, SQL, JavaScript, PHP, and other open source languages).
• Web-based user interface design and development experience using advanced DHTML, CSS, JavaScript, AJAX, JQuery and Bootstrap;

knowledge of ETL and visualization tools; Machine Learning concepts and tools (R, Python and JavaScript, FME and SSIS).