Senior Data DeveloperCpus Engineering Staffing Solutions Inc. • Pickering, ON, CA
Senior Data Developer
Cpus Engineering Staffing Solutions Inc. • Pickering, ON, CA
30+ days ago
Job type
- Full-time
Job descriptionBuild and productionize modular and scalable data ELT / ETL pipelines and data infrastructure leveraging the wide range of data sources across the organization. Implement data ingestion and curation data pipelines that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect. Work closely with Data Architect, infrastructure and cyber teams to ensure data is secure in transit and at rest. Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle. Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods. Provide production support for issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity. Collaborate with data architect, business analysts, data scientists, data engineers, data analysts, solution architects and data modelers to develop data pipelines to feed our data marketplace. Assist in identifying, designing, and implementing internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SOL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Collibra, and Power Bl. Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban / SCRUM toolsets. Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use. Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SOL, consuming data sources in XML, CSV, JSON, REST APls, or other formats. Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base. Implement orchestration of data pipeline execution to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use. Create tooling to help with day to day tasks, and reduce toil via automation wherever possible. Work with Continuous Integration / Continuous Delivery and DevOps pipelines to automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning. Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis. Implement and manage appropriate access to data products via role-based access control. Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases. Participate in peer code review sessions, and approve non-production pull requests. Completion of a four-year University education in computer science, computer / software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning. Experience as a Data Engineer designing and building data pipelines. Fluent in creating data processing frameworks using Python, PySpark, SparkSOL and SOL Experience with Azure Data Factory, ADLS, Synapse Analytics and Databricks Experience building data pipelines for Data Lakehouses and Data Warehouses Good understanding of data structures and data processing frameworks Knowledge of data governance and data quality principles Effective communication skills to translate technical details to non-technical stakeholders
We are currently requesting resumes for the following position : Senior Data Developer
Resume Due Date : Wednesday, January 22
nd
, 2025 (5 : 00PM EST)
Job ID : 25-010
Number of Vacancies : 1
Level : Senior
Duration : 10 Months
Hours of work : 35 per week
Location : 889 Brock Rd., Pickering
Work Mode : 100% Remote
Job Overview
JOB FUNCTION
- As a Senior Data Developer, you will be responsible for building and supporting the data driven applications which enable innovative, customer centric digital experiences.
- You will be working as part of a cross-discipline agile team who help each other solve problems across all business areas.
- You will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation.
- You will employ best practice in development, security and accessibility to achieve the highest quality of service for our customers.
JOB DUTIES
Qualifications
Education
Experience
Our client is dedicated to promoting employment equity and encourages applications from equity-seeking communities including but not limited to : Indigenous Peoples, racialized individuals, persons with disabilities, and women. Our client aims to build a diverse team that reflects the communities it serves, enhancing its ability to meet their needs. We are committed to an inclusive and accessible work environment and invites all qualified individuals to apply, offering accommodations during the application, interview and onboarding process as needed. This effort supports our client’s long-term strategy for equity, diversity, and inclusion.
#J-18808-Ljbffr
Create a job alert for this search
Senior Developer Data • Pickering, ON, CA
Similar jobs
As a Senior Data Scientist, you will work remotely on an hourly paid basis to review AI-generated analytical reasoning, code, and model outputs, as well as generate high-quality reference solutions...Show more
This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company.Watch and monitor data systems.
Investigate and fix data problems.Work closely wi...Show more
Join a Global Leader in Clinical Research.Are you a seasoned Clinical Data Manager with a passion for driving high-quality data outcomes across global clinical trials? We are looking for a Senior C...Show more Join a Global Leader in Clinical Research.Are you a seasoned Clinical Data Manager with a passion for driving high-quality data outcomes across global clinical trials? We are looking for a Senior C...Show more Senior / Principal Statistical Programmer | Small CRO | Remote.We're partnered with a small CRO who are experiencing a large amount of growth within Biometrics.
As a Senior Statistical Programmer, you...Show more This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company.Watch and monitor data systems.
Investigate and fix data problems.Work closely wi...Show more Join a Global Leader in Clinical Research.Are you a seasoned Clinical Data Manager with a passion for driving high-quality data outcomes across global clinical trials? We are looking for a Senior C...Show more 
Reports to : Head of IT & Engineering from the Development Team.At Fulfillment IQ, we are transforming the future of logistics technology.
As an award-winning consultancy and technology partner, ...Show more
ArcLight Consulting, an Addison Group Company, is dedicated to ensuring that Cloud Solutions clients are successful with their investment.
For over 15 years, ArcLight experts have provided guidance ...Show more ArcLight Consulting, an Addison Group Company, is dedicated to ensuring that Cloud Solutions clients are successful with their investment.
For over 15 years, ArcLight experts have provided guidance ...Show more This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company.Watch and monitor data systems.
Investigate and fix data problems.Work closely wi...Show more As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...Show more 
The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Sol...Show more
Our client is sourcing a Senior Analyst for a 6-month contract.Responsible for month-end, quarter-end, and annual close process in accordance with company requirements.
Responsible for expense reimb...Show more
As a Data Architect you will be responsible for leading the Azure architecture, design and delivery of data models and data products which enable innovative, customer-centric digital experiences.Yo...Show more The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Sol...Show more 
Role : Principal SAP Datasphere & BDC Consultant.Must have Excellent Communication skill.At least 14 years of experience with Information Technology.
SAP BW on HANA and SAP BW / 4HANA architecture and...Show more The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Sol...Show more
Senior Data Scientist
SuperAnnotate • Uxbridge, Ontario, CA
Remote
Full-time
Last updated: 23 hours ago
Data Engineer
Mastech Digital • oshawa, on, ca
Full-time
Last updated: 20 days ago • Promoted
Senior Clinical Data Manager
Warman O'Brien • oshawa, on, ca
Full-time
Last updated: 30+ days ago • Promoted
Senior Clinical Data Manager - Warman O'Brien
Warman O'Brien • oshawa, on, ca
Full-time
Last updated: 30+ days ago • Promoted
Senior Statistical Programmer
Warman O'Brien • oshawa, on, ca
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer - oshawa
Mastech Digital • oshawa, on, ca
Full-time
Last updated: 20 days ago • Promoted
Senior Clinical Data Manager - oshawa
Warman O'Brien • oshawa, on, ca
Full-time
Last updated: 30+ days ago • Promoted
Tech Lead
Fulfillment IQ • Pickering, ON, Canada
Full-time
Last updated: 30+ days ago • Promoted
Oracle Cloud Senior Technical Lead
ArcLight Consulting • oshawa, on, ca
Full-time
Last updated: 30+ days ago • Promoted
Oracle Cloud Senior Technical Lead - ArcLight Consulting
ArcLight Consulting • oshawa, on, ca
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer - Mastech Digital
Mastech Digital • oshawa, on, ca
Full-time
Last updated: 20 days ago • Promoted
Senior SQL Engineer
SuperAnnotate • Ajax, Ontario, CA
Remote
Full-time
Last updated: 23 hours ago
Senior Full Stack Developer
Luxoft • oshawa, on, ca
Full-time
Last updated: 18 days ago • Promoted
Senior Analyst
Vaco by Highspring • Uxbridge, ON, CA
Temporary
Last updated: 7 days ago • Promoted
Data Architect
Cpus Engineering Staffing Solutions Inc. • Pickering
Full-time
Last updated: 14 days ago • Promoted
Senior Full Stack Developer - oshawa
Luxoft • oshawa, on, ca
Full-time
Last updated: 18 days ago • Promoted
SAP Datasphere & BDC Consultant (PR - Citizen Only - T4) - Ampstek
Ampstek • oshawa, on, ca
Full-time
Last updated: 8 hours ago • Promoted • New!
Senior Full Stack Developer - Luxoft
Luxoft • oshawa, on, ca
Full-time
Last updated: 18 days ago • Promoted