RQ10840 - Software Developer - ETL - Senior

Job Description

Responsibilities:

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
  
• Required to translate technical systems specifications into working, tested applications. This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
  
• Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
  

General Skills:

• Experience in programming and analysis; specialized software package support at the specified experience level
  
• Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
  
• Experience in structured methodologies for the development, design, implementation and maintenance of applications
  
• Experience in design, code, test, debug and document applications
  
• Experience in the use of object and/or third generation language development tools
  
• Experience in one or more programming languages
  
• Experience in application design, latest design patters, deployment and troubleshooting
  
• Experience with relational and hierarchical database technologies
  
• Experience in the use of information retrieval packages using query languages
  
• Experience with one or more communications protocols
  
• Experience in structured methodologies for the design, development, implementation and maintenance of applications
  
• Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts
  
• Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
  
• A team player with a track record for meeting deadlines
  

ETL Skills

• Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users
  
• Knowledge and experience maintaining and improving already existing processes.
  
• Knowledge and experience ensuring that the data architecture is scalable and maintainable
  
• Knowledge and experience working with the business in designing and delivering correct, high quality data
  
• Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
  
• Experience preparing detailed documentation for further reference
  

Desirable Skills:

• Knowledge and experience with programming Internet-ready applications
  
• Knowledge and experience in rapid application development (RAD) and Agile methodologies
  
• Knowledge and understanding of Information Management principles, concepts, policies and practices
  
• Experience with middleware and gateways
  
• Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging
  
• Ability to provide post-implementation support and resolve any post-implementation technical issues
  
• Experience conducting design walkthrough sessions with project team
  
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
  
• Ability to provide user and system documentation as required
  
  

Requirements

Experience and Skill Set Requirements

Technical Skills – 40%

5+ years of experience with:

• Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas
• Design, build, automate and optimize complex data ETL/ELT processes using PL/SQL and equivalent
• Writing complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation(cleansing), and data loading.
• Creating data assets (denormalized) from highly normalized Oracle database, and load the data asset to another type of DBMS (Microsoft SQL DBs, Postgress, etc.)
• Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
• Advanced SQL skills (PL/SQL, TSQL)
• Scripting languages (Python, Unix shell)
• Cloud technologies (Azure, Google, AWS)
• Advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory
• Proficient in creating Data Factory pipelines for copy activity and custom Azure development
• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery
• Elasticsearch for search/reporting, tuning for performance optimization
• Working knowledge of issue tracking system JIRA, Azure DevOps
• Using Git hub for version control and data model changes
• Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB)
• PL/SQL Programming for database change tracking and data warehousing
• Data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX)
• /Recovery (Restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage

Core Skills – 30%

5+ years of experience with:

• Technical analysis, program code, detailed programming and reports specifications, program design, writing and /or generating code, and conducting unit tests

• Software in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways

• Developing and maintaining system design models, technical documentation and specifications

• Conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements/specifications/documentation

• Provide Business intelligence and data analytics, data warehouse design, dimensional data modeling, relational data modelling development and support

• Conduct research and assessment of options for technical design issues

• Contributing to design/development project plans, including work breakdown and resources estimates

• Working with the business analysts to translate the business requirements and functional specifications into an application design appropriate to meet the business and operational/IT needs

• Working with technical systems specifications and translating them into working, tested applications for large, complex, mission critical applications

• Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services

• Analysis, design and development work on complex, multi-tier web-based applications, micro-services architecture, and off-the-shelf solutions

• Proven technical leadership skills with ability to identify areas for improvement, and recommend solutions

• Undertaking proof of technology with test data to simulate application load and performance tuning related applications

• Providing software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways

• Providing application programming support for incident management, application functionality sustainment, performance tuning and technical documentation

Web database performance optimization

• Ensuring compliance with architecture framework and system standards, and Agile Development Methodology

• Software Development Lifecycle (SDLC) end-to-end Agile/scrum and Waterfall methodologies

• Knowledge and experience with leading-edge technologies, design criteria including usability, security, and privacy or web and mobile applications.

Public Sector Experience – 5%

• Experience working with inter-jurisdiction projects between federal/provincial/municipal governments

• Knowledge of the provincial Environmental services and the legislative framework that governs the data

• Experience with data migration and integration of with different Environmental systems

• Knowledge of OPS Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry-standard practices

• Experience adopting and adhering to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS • • Gating process, and OPS Standard Systems Development Methodologies.

General Skills – 25%

• Exceptional analytical, problem solving and decision-making skills

• Demonstrated strong interpersonal, verbal and written communication skills

• Demonstrated troubleshooting and critical thinking experience

• Demonstrated ability to apply strong listening skills to facilitate issue resolution

• Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships

• Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively

• Highly motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multitasking abilities, and a proven track record for meeting strict deadlines.

Must Have:

• Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas
  
• Design, build, automate and optimize complex data ETL/ELT processes using PL/SQL and equivalent
  
• Writing complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation(cleansing), and data loading.
  
• Creating data assets (denormalized) from highly normalized Oracle database, and load the data asset to another type of DBMS (Microsoft SQL DBs, Postgress, etc.)
  
• Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
  
• Advanced SQL skills (PL/SQL, TSQL)
  
• Scripting languages (Python, Unix shell)
  
• Cloud technologies (Azure, Google, AWS)
  
• Advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory
  
• Proficient in creating Data Factory pipelines for copy activity and custom Azure development
  
• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery
  
• Elasticsearch for search/reporting, tuning for performance optimization
  
• Working knowledge of issue tracking system JIRA, Azure DevOps
  
• Using Git hub for version control and data model changes
  
• Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB)
  
• PL/SQL Programming for database change tracking and data warehousing
  
• Data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX)
  
• Recovery (Restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage
  

Requirements
Experience and Skill Set Requirements Technical Skills – 40% 5+ years of experience with: • Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas • Design, build, automate and optimize complex data ETL/ELT processes using PL/SQL and equivalent • Writing complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation(cleansing), and data loading. • Creating data assets (denormalized) from highly normalized Oracle database, and load the data asset to another type of DBMS (Microsoft SQL DBs, Postgress, etc.) • Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration • Advanced SQL skills (PL/SQL, TSQL) • Scripting languages (Python, Unix shell) • Cloud technologies (Azure, Google, AWS) • Advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory • Proficient in creating Data Factory pipelines for copy activity and custom Azure development • PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery • Elasticsearch for search/reporting, tuning for performance optimization • Working knowledge of issue tracking system JIRA, Azure DevOps • Using Git hub for version control and data model changes • Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB) • PL/SQL Programming for database change tracking and data warehousing • Data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX) • /Recovery (Restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage Core Skills – 30% 5+ years of experience with: • Technical analysis, program code, detailed programming and reports specifications, program design, writing and /or generating code, and conducting unit tests • Software in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways • Developing and maintaining system design models, technical documentation and specifications • Conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements/specifications/documentation • Provide Business intelligence and data analytics, data warehouse design, dimensional data modeling, relational data modelling development and support • Conduct research and assessment of options for technical design issues • Contributing to design/development project plans, including work breakdown and resources estimates • Working with the business analysts to translate the business requirements and functional specifications into an application design appropriate to meet the business and operational/IT needs • Working with technical systems specifications and translating them into working, tested applications for large, complex, mission critical applications • Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services • Analysis, design and development work on complex, multi-tier web-based applications, micro-services architecture, and off-the-shelf solutions • Proven technical leadership skills with ability to identify areas for improvement, and recommend solutions • Undertaking proof of technology with test data to simulate application load and performance tuning related applications • Providing software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways • Providing application programming support for incident management, application functionality sustainment, performance tuning and technical documentation Web database performance optimization • Ensuring compliance with architecture framework and system standards, and Agile Development Methodology • Software Development Lifecycle (SDLC) end-to-end Agile/scrum and Waterfall methodologies • Knowledge and experience with leading-edge technologies, design criteria including usability, security, and privacy or web and mobile applications. Public Sector Experience – 5% • Experience working with inter-jurisdiction projects between federal/provincial/municipal governments • Knowledge of the provincial Environmental services and the legislative framework that governs the data • Experience with data migration and integration of with different Environmental systems • Knowledge of OPS Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry-standard practices • Experience adopting and adhering to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS • • Gating process, and OPS Standard Systems Development Methodologies. General Skills – 25% • Exceptional analytical, problem solving and decision-making skills • Demonstrated strong interpersonal, verbal and written communication skills • Demonstrated troubleshooting and critical thinking experience • Demonstrated ability to apply strong listening skills to facilitate issue resolution • Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships • Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively • Highly motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multitasking abilities, and a proven track record for meeting strict deadlines. Must Have: Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas Design, build, automate and optimize complex data ETL/ELT processes using PL/SQL and equivalent Writing complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation(cleansing), and data loading. Creating data assets (denormalized) from highly normalized Oracle database, and load the data asset to another type of DBMS (Microsoft SQL DBs, Postgress, etc.) Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration Advanced SQL skills (PL/SQL, TSQL) Scripting languages (Python, Unix shell) Cloud technologies (Azure, Google, AWS) Advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory Proficient in creating Data Factory pipelines for copy activity and custom Azure development PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery Elasticsearch for search/reporting, tuning for performance optimization Working knowledge of issue tracking system JIRA, Azure DevOps Using Git hub for version control and data model changes Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB) PL/SQL Programming for database change tracking and data warehousing Data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX) Recovery (Restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage