Software Developer - ETL

Job Title: Software Developer - ETL

Location: Toronto, Ontario

Work Model: Hybrid

Duration: 7 months

Extension: 1 Time

Must Haves

• Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas
• Design, build, automate and optimize complex data ETL/ELT processes using PL/SQL and equivalent
• Writing complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation(cleansing), and data loading.
• Creating data assets (denormalized) from highly normalized Oracle database, and load the data asset to another type of DBMS (Microsoft SQL DBs, Postgress, etc.)
• Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
• Advanced SQL skills (PL/SQL, TSQL)
• Scripting languages (Python, Unix shell)
• Cloud technologies (Azure, Google, AWS)
• Advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory
• Proficient in creating Data Factory pipelines for copy activity and custom Azure development
• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support
• Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that's geared towards the needs of end users
• Knowledge and experience ensuring that the data architecture is scalable and maintainable
• Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions

Description / Responsibilities / Skills

Responsibilities

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
• Required to translate technical systems specifications into working, tested applications. This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
• Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.

ETL Skills

• Knowledge and experience maintaining and improving already existing processes.
• Knowledge and experience working with the business in designing and delivering correct, high quality data
• Experience preparing detailed documentation for further reference

Core Skills 30%

• Conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities

Public Sector Experience 5%

• Knowledge of OPS Enterprise Architecture artifacts (or similar), processes and practices
• Experience adopting and adhering to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS Gating process

Deliverables

• Detailed programming specifications and unit-tested applications
• System design models, technical documentation and specifications
• User and system documentation as required
• Post-implementation support and resolution of technical issues
• Design walkthrough sessions with project team

Experience & Skill Set Requirements

Technical Skills 40%

• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery
• Elasticsearch for search/reporting, tuning for performance optimization
• Working knowledge of issue tracking system JIRA, Azure DevOps
• Using Git hub for version control and data model changes
• Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB)
• PL/SQL Programming for database change tracking and data warehousing
• Data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX)
• /Recovery (Restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage

Core Skills 30%

• Technical analysis, program code, detailed programming and reports specifications, program design, writing and /or generating code, and conducting unit tests
• Software in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Developing and maintaining system design models, technical documentation and specifications
• Conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements/specifications/documentation
• Provide Business intelligence and data analytics, data warehouse design, dimensional data modeling, relational data modelling development and support
• Conduct research and assessment of options for technical design issues
• Contributing to design/development project plans, including work breakdown and resources estimates
• Working with the business analysts to translate the business requirements and functional specifications into an application design appropriate to meet the business and operational/IT needs
• Working with technical systems specifications and translating them into working, tested applications for large, complex, mission critical applications
• Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services
• Analysis, design and development work on complex, multi-tier web-based applications, micro-services architecture, and off-the-shelf solutions
• Proven technical leadership skills with ability to identify areas for improvement, and recommend solutions
• Undertaking proof of technology with test data to simulate application load and performance tuning related applications
• Providing software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Providing application programming support for incident management, application functionality sustainment, performance tuning and technical documentation
• Web database performance optimization
• Ensuring compliance with architecture framework and system standards, and Agile Development Methodology
• Software Development Lifecycle (SDLC) end-to-end Agile/scrum and Waterfall methodologies
• Knowledge and experience with leading-edge technologies, design criteria including usability, security, and privacy or web and mobile applications.

Public Sector Experience 5%

• Experience working with inter-jurisdiction projects between federal/provincial/municipal governments
• Knowledge of the provincial Environmental services and the legislative framework that governs the data
• Experience with data migration and integration of with different Environmental systems
• Knowledge of OPS Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry-standard practices
• Experience adopting and adhering to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS Gating process, and OPS Standard Systems Development Methodologies.

General Skills 25%

• Exceptional analytical, problem solving and decision-making skills
• Demonstrated strong interpersonal, verbal and written communication skills
• Demonstrated troubleshooting and critical thinking experience
• Demonstrated ability to apply strong listening skills to facilitate issue resolution
• Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships
• Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively
• Highly motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multitasking abilities, and a proven track record for meeting strict deadlines.