Assignment : RQ08584 - Software Developer - ETL - Senior Job Title : ETL & Azure Data Engineer Requisition (SS)...Show moreLast updated: 17 hours ago
Promoted
Software Developer (Backend)
Game HiveMississauga, ON, Canada
serp_jobs.filters.currency_variable_a_yearly
This job is currently not accepting applicants.Show moreLast updated: 30+ days ago
Promoted
SAS AML Expert
TES The Employment Solution Inc.ON, Canada
Full-time
Reference Code : 049239 This will be local to Toronto and will be once a week in their Downtown office.This will be part of a Consulting project we have undertaken, initial duration is 2 months but...Show moreLast updated: 6 days ago
Promoted
Golang Developer
SA TechnologiesRichmond Hill Central, ON, ca
Unlock New Career Horizons with SA Technologies Inc.As a Great Place to Work Certified company, recognized as one of the Best Places for Women, and a CMMI Level 5 Company, we are committed to creat...Show moreLast updated: 18 days ago
Advanced Software Developer
Snowed In StudiosON, CA
CA$110,000.00–CA$135,000.00 yearly
Remote
Full-time
Quick Apply
As part of Keywords Studios’ Create service line, we provide support to some of the most exciting games being made today.
You’ll have the chance to make a global impact, working in a studio known fo...Show moreLast updated: 30+ days ago
Promoted
RQ08659 Software Developer - ETL
Randstad CanadaNorth York, Ontario, CA
Temporary
Quick Apply
Are you a highly skilled ETL Developer with expertise in Microsoft SSIS, Delta Lake, and Databricks pipelines? Our high-profile client is seeking a Software Developer - ETL to design, develop, and ...Show moreLast updated: 30+ days ago
Senior Python ETL developer
Sun LifeNorth York, Ontario
Full-time
Do you want to build and maintain mission critical data processing and transformation systems that will help run one of Canada’s biggest financial institutions? Do you enjoy being part of a tight-k...Show moreLast updated: 30+ days ago
Cloud Data Engineers
Emonics LLCOntario, Canada
CA$60,000.00 yearly
Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).
Must be able to work with large volumes of data coming from various sources...Show moreLast updated: 30+ days ago
Promoted
Senior Java Developer
RecootyGolden Horseshoe, ON, Canada
As a Lowfoot Senior Java Developer, you’ll focus on building and implementing our suite of energy SAAS products.You’re an experienced Java developer who knows how the web works, and can build and s...Show moreLast updated: 19 days ago
Python Developer
Tek Leaders IncMontreal, Canada, Ontario, Canada
Role : Python Developer Location : Montreal, Canada (Day 1 On-site – All 5 days' Work from Office) Duration Long Term Contract Job Desc...Show moreLast updated: 22 days ago
PHP Developer
PeopleToGoWoodbridge, Ontario
CA$80.00–CA$100.00 hourly
Quick Apply
Our client currently has an opening for a PHP Developer to join their team.Development of PHP based nework applications.Design and implementation of applications from use cases.Database (MySQL) des...Show moreLast updated: 30+ days ago
ETL Lead
eTeamRemote, ON
CA$60.00–CA$65.00 hourly
Remote
Data management solution for batch and real time data warehouse / data lake designs.Strong working experience in AWS RedShift and AWS Glue, Crawler and Data Catalog.
Technical expert in on-prime, clou...Show moreLast updated: 30+ days ago
Software Developer (intermediate to senior)
JLI Consulting Talent SearchWoodbridge ON
CA$85.00 hourly
Full-time
Our client, an eServices company, is in search for an experienced software solutions developer.In this role, you will be working with state of the art technologies, in a high performance fully matu...Show moreLast updated: 30+ days ago
Software Developer
Empire LifeNorth York, ON, CA
Software Developer - Back Office.Empire life is looking to hire a Back Office Software Developer to join our Information Technology team! .
Empire Life is growing in our digital landscape.In order t...Show moreLast updated: 30+ days ago
Office Location : 87 Sir William Hearst Ave., Toronto, Ontario M3M 0B4
Organization : Labour and Transportation Cluster
Extension # of Days : 250.00
Ministry : Ministry of Transportation
Business Days : 252.00
Note : Candidate is required to come in office 3 days a week
Must haves :
Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
Description
Deliverables section :
Scope of Services and Deliverables - The Services and Deliverables to be provided by the Vendor will include the following :
Participate in the review of project, work request and maintenance release artefacts - Use Case, System Requirement Specification, etc.
Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.
Design logical and physical data models using Sybase Power Designer.
Produce transformation mapping document.
Implement data pipelines using Azure Data Factory (ADF), stored procedure, and Informatica PowerCenter performing extraction, transformation, and loading activities.
Implement solutions using Logic App and Function App.
Generate structured JSON file using ADF / SQL.
Develop Azure CI / CD pipeline to automate ADF release.
Develop complex Oracle PL / SQL program to fulfill project requirements.
Implement complex data conversion, e.g., binary to character, EBCDIC to UTF.
Implement complex data transformation(s) for derived and calculated values.
Integrate data sets from diverse source systems.
Implement ADF for initial data load and incremental load.
Promote ADF and Informatica ETL / ELT through all Ministry environments including Development, Integration Testing, QA, UAT, Production.
Resolve and troubleshoot ADF pipeline, stored procedure, and Informatica workflow technical problems.
Monitor and analyze incident, provide timely resolution.
Collaborate with IT Professionals throughout the Software Development Life Cycle.
Document information from diverse business area stakeholders and subject matter experts.
Optimize performance of ADF pipeline, Azure SQL and Synapse databases, and Informatica workflow.
Monitor application functionality and performance on daily basis.
Provide effective knowledge transfer to Ministry staff at all stages of this assignment.
Evaluation Table
ETL Development-Data Integration - 40%
Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including :
Self-Hosted Integration Runtime
Data movement, ETL pipelines
Performance tuning on large data volumes
Complex data transformations
ADF Debugger to validate data transformation.
Azure Roles
Experience with Informatica, including :
Workflow Manager
Repository Manager
Designer
Workflow Monitor
Experience with developing solutions using Logic App and Function App.
Experience in rapid application development (RAD) methodologies.
Experience in maintaining and improving existing ETL processes.
Experience in investigating data to identify potential issues within ETL pipelines.
Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
Azure Technologies - 40%
Experience with CI / CD (DevOps) pipelines and concepts, including :
Azure Resource Management
GitHub Repo
Source code version control
Branching, pull requests, build, release, multiple parallel development repositories merge.
Experience with Azure DevOps, including :
Azure Boards
Azure Test Plans
Azure Pipelines
Azure Repos
Azure Artefacts
Oracle PL / SQL Development - 10%
Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL / SQL programs.
Database Technologies - 10%
Experience with Oracle, Microsoft SQL Server database and tools.
Experience with relational and hierarchical database technologies.
Extensive knowledge of Azure SQL DB and Synapse platforms, including :