Title : Sr. Azure Data Engineering Specialist (Databricks and Synapse)
Location : This role can be situated anywhere in Canada within proximity to a CGI office
Are you an experienced Azure Data Engineering professional interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients?
Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to create a robust data engineering infrastructure to sort that mess out?
If you have that technical expertise of building pipelines and enabling data engineering or ETL in organizations, a genuine flair for solving problems, and the mindset to collaborate with diverse clients and team members alike, we're looking for you.
Expertise in Azure Databricks and Synapse experience is mandatory for this role
This is a hands-on role
As a Sr. Azure Data Engineer on this team your responsibilities will include :
- Delivering on areas of data preparation and transformations and ETL or ELT development on Azure - Azure Data Factory (ADF), Synapse, Azure Databricks, Azure Data Lake (ADLS), Azure SQL database, Azure SQL Datawarehouse
- Building Streaming Data pipelines with Databricks
- Working in a business environment with large-scale, complex and big data datasets and dispersed data sources
- Using SQL or Advanced SQL and Python skills as necessary
- Gathering client requirements, coding and building Data Engineering pipelines in Azure
- Implementing proof of concepts to show value and then package and scale to full data engineering scale on both on-prem and cloud environments
- Strategically collaborating with the clients to explore data sources and build Power BI dashboards with Azure Data Engineering
- Supporting and collaborating with the other Data Engineers or Data Scientists in the team with technical knowledge
Essential Qualifications :
- Azure Databricks and Synapse experience is mandatory
- Building streaming pipelines on Azure experience is mandatory
- Total 5-7+ years’ experience in Data Engineering is required to apply to this role
- 3 years or more in Azure Data Engineering
- Data analysis, storage, data pipelines, and orchestration
- Expert Python and SQL skills
- Experience working on Big Data
Nice to Have Qualifications
- Experience in data engineering with ML projects
- Experience with data pipeline and workflow management tools eg. Airflow, Jenkins etc.
- Experience working with Spark / Hive / HDFS
- Experience in building strong Power BI Dashboards with DAX queries, Power Apps, Power Automate, and Logic Apps
Sr. Azure Data Engineering Specialist (Databricks and Synapse)
Are you an experienced Azure Data Engineering professional interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients? Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to creat...
Senior Data Consultant (Azure Databricks/Java)
The Data Consultant needed to have Experience in Azure Data Bricks, Azure SQL, Java programming and should have migration experience on Azure Cloud. Tech Stack: Java Version 11, Spring boot, Data bricks and Azure Data Factory, Azure Cloud Azure, Microservices, Jboss, Mongo DB. Data engineering, data...
Sr. Business Analyst to perform data analysis, mining, aggregation and interpretation to optimizing business operations for a major banking client - 6301
Create and maintain project schedules by developing and/or contributing to project plans and specifications, monitoring milestone completion, providing timely reporting of issues that impact project progress, coordinating actions and resolving conflicts;. Demonstrate up-to-date expertise in Informat...
Power Platform and Data Visualization Specialist
Reporting to the Director, Business Solutions and Data Services, the Power Platform and Data Visualization Specialist will continuously evaluate reporting system needs, and design, develop, streamline and automate reporting processes. Provide technical support on the platform and data management pro...
Power BI & Data Analytics Specialist
Data Integration: Understand the data from various systems - Clarity PPM data & other data sources such as financial systems or HR databases, to provide a comprehensive view of project performance and portfolio management. Data Modeling and Transformation: Extract/download data from Clarity PPM and ...
Sr. Engineering Specialist
The Sr Engineering Specialist is responsible for leading the design of engineering projects, acting as technical lead on the project and reviewing/stamping drawings and designs as needed, and managing the technical engineering deliverables. Works collaboratively with other WMC Engineers, Technologis...
SR Functional and Technical Resource with Eagle Pace System experience to support the data hub for our investment management client.
The Eagle PACE system, integrated with several other systems and data marts, handles large volumes of investment data, including positions, transactions, SMF, and Reference data. Microsoft SQL Database Schema for large-size databases consisting of investment data like positions, transactions, SMF, a...
Sr Specialist, Large Complex & Specialty Claims
A minimum of 4 years claims experience handling large CGL and/or bodily injury claims Experience with mediation, arbitration and litigation. Actual salary for the role may vary depending on work location of the successful candidate and other factors including but not limited to, skills, education, e...
Sr Data Engineering Manager
The individual for this position will be a technical expert providing expertise in areas of data architecture, data management, data quality, data governance and data engineering. Contribute to building generic frameworks for data ingestion, data processing, data transformation and data integrations...
Sr. Manager, Wealth Data Management & Governance
Creating a culture where data is managed as a valuable corporate asset, the role requires the ability to establish collaborative working relationships with Business and Technology partners to manage metadata and data flows that enable data usage and impact analysis for critical business decision-mak...