RQ11301 - Software Developer - ETL - Senior

Job Description

Responsibilities:

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
  
• Required to translate technical systems specifications into working, tested applications.
  
• This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
  
• Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
  

General Skills:

• Experience in programming and analysis; specialized software package support at the specified experience level
  
• Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
  
• Experience in structured methodologies for the development, design, implementation and maintenance of applications
  
• Experience in design, code, test, debug and document applications
  
• Experience in the use of object and/or third generation language development tools
  
• Experience in one or more programming languages
  
• Experience in application design, latest design patters, deployment and troubleshooting
  
• Experience with relational and hierarchical database technologies
  
• Experience in the use of information retrieval packages using query languages
  
• Experience with one or more communications protocols
  
• Experience in structured methodologies for the design, development, implementation and maintenance of applications
  
• Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts
  
• Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
  
• A team player with a track record for meeting deadlines
  

ETL Skills:

• Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users
  
• Knowledge and experience maintaining and improving already existing processes.
  
• Knowledge and experience ensuring that the data architecture is scalable and maintainable
  
• Knowledge and experience working with the business in designing and delivering correct, high quality data
  
• Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
  
• Experience preparing detailed documentation for further reference
  

Desirable Skills:

• Knowledge and experience with programming Internet-ready applications
  
• Knowledge and experience in rapid application development (RAD) methodologies
  
• Knowledge and understanding of Information Management principles, concepts, policies and practices
  
• Experience with middleware and gateways
  
• Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging
  
• Ability to provide post-implementation support and resolve any post-implementation technical issues
  
• Experience conducting design walkthrough sessions with project team
  
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
  
• Ability to provide user and system documentation as required
  

Requirements

Experience and Skill Set Requirements:

Must Haves:

• Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
  

Skill Set Requirements:

ETL Development-Data Integration:

• Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
  
• Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including:
  
• Self-Hosted Integration Runtime
  
• Data movement, ETL pipelines
  
• Performance tuning on large data volumes
  
• Complex data transformations
  
• ADF Debugger to validate data transformation.
  
• Azure Roles
  
• Experience with Informatica, including:
  
• Workflow Manager
  
• Repository Manager
  
• Designer
  
• Workflow Monitor
  
• Experience with developing solutions using Logic App and Function App
  
• Experience in rapid application development (RAD) methodologies.
  
• Experience in maintaining and improving existing ETL processes.
  
• Experience in investigating data to identify potential issues within ETL pipelines.
  
• Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
  

Azure Technologies:

• Experience with CI/CD (DevOps) pipelines and concepts, including:
  
• Azure Resource Management
  
• GitHub Repo
  
• Source code version control
  
• Branching, pull requests, build, release, multiple parallel development repositories merge.
  
• Experience with Azure DevOps, including:
  
• Azure Boards
  
• Azure Test Plans
  
• Azure Pipelines
  
• Azure Repos
  
• Azure Artefacts
  

Oracle PL/SQL Development:

• Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.
  

Database Technologies:

• Experience with Oracle, Microsoft SQL Server database and tools.
  
• Experience with relational and hierarchical database technologies.
  
• Extensive knowledge of Azure SQL DB and Synapse platforms, including:
  
• Performance tuning on large data volume
  

Requirements
Experience and Skill Set Requirements: Must Haves: Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation. Skill Set Requirements: ETL Development-Data Integration: Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation. Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including: Self-Hosted Integration Runtime Data movement, ETL pipelines Performance tuning on large data volumes Complex data transformations ADF Debugger to validate data transformation. Azure Roles Experience with Informatica, including: Workflow Manager Repository Manager Designer Workflow Monitor Experience with developing solutions using Logic App and Function App Experience in rapid application development (RAD) methodologies. Experience in maintaining and improving existing ETL processes. Experience in investigating data to identify potential issues within ETL pipelines. Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI. Azure Technologies: Experience with CI/CD (DevOps) pipelines and concepts, including: Azure Resource Management GitHub Repo Source code version control Branching, pull requests, build, release, multiple parallel development repositories merge. Experience with Azure DevOps, including: Azure Boards Azure Test Plans Azure Pipelines Azure Repos Azure Artefacts Oracle PL/SQL Development: Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs. Database Technologies: Experience with Oracle, Microsoft SQL Server database and tools. Experience with relational and hierarchical database technologies. Extensive knowledge of Azure SQL DB and Synapse platforms, including: Performance tuning on large data volume