Data Engineer

Overview

Get AI-powered advice on this job and more exclusive features.

Location : Mississauga, ON (3 days onsite per week is a must)

Duration : 3-6 months Contract to hire with end client

Responsibilities

• Design and implement scalable, reliable, and high-performance data architectures on the Azure Cloud platform.
• Collaborate with data architects and other stakeholders to define data requirements and architecture standards.
• Develop end-to-end data pipelines, ensuring efficient and reliable data movement across various stages, from ingestion to consumption.
• Leverage SSIS for on-premises ETL development and integration with Azure-based solutions.
• Write complex SQL queries for data extraction, transformation, and reporting purposes.
• Utilize Azure Data Factory, Azure Databricks, and other relevant services to orchestrate and optimize data workflows.
• Design and implement data models that support business requirements and enable efficient querying and analysis.
• Optimize data storage and retrieval processes for performance and cost-effectiveness.
• Integrate diverse data sources into a unified data platform, ensuring data consistency, accuracy, and reliability.
• Implement data integration patterns using Azure services such as Azure Data Factory, Azure Logic Apps, and Azure Functions.
• Write complex SQL queries for data extraction, transformation, and reporting purposes.
• Ensure compliance with data governance and privacy regulations.
• Monitor data pipeline performance and proactively identify and resolve bottlenecks or issues.
• Implement performance tuning strategies to optimize data processing and reduce latency.
• Collaborate with cross-functional teams, including analysts and business stakeholders.
• Document data engineering processes, data flows, and system architecture for knowledge sharing and future reference.

Qualifications

At People Force Consulting Inc, we are committed to fostering diversity, equity, and inclusion. We welcome applicants from all backgrounds, including Indigenous peoples, women, visible minorities, persons with disabilities, and members of 2SLGBTQIA+ communities. If you require any accommodations during the recruitment or interview process, please let us know, we will work with you to ensure an accessible and positive experience.

#J-18808-Ljbffr