Sr. Azure Data Engineering Specialist (Databricks and Synapse)
Title : Sr. Azure Data Engineering Specialist (Databricks and Synapse)
Location : This role can be situated anywhere in Canada within proximity to a CGI office
Are you an experienced Azure Data Engineering professional interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients?
Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to create a robust data engineering infrastructure to sort that mess out?
If you have that technical expertise of building pipelines and enabling data engineering or ETL in organizations, a genuine flair for solving problems, and the mindset to collaborate with diverse clients and team members alike, we're looking for you.
Expertise in Azure Databricks and Synapse experience is mandatory for this role
This is a hands-on role
As a Sr. Azure Data Engineer on this team your responsibilities will include :
- Delivering on areas of data preparation and transformations and ETL or ELT development on Azure - Azure Data Factory (ADF), Synapse, Azure Databricks, Azure Data Lake (ADLS), Azure SQL database, Azure SQL Datawarehouse
- Building Streaming Data pipelines with Databricks
- Working in a business environment with large-scale, complex and big data datasets and dispersed data sources
- Using SQL or Advanced SQL and Python skills as necessary
- Gathering client requirements, coding and building Data Engineering pipelines in Azure
- Implementing proof of concepts to show value and then package and scale to full data engineering scale on both on-prem and cloud environments
- Strategically collaborating with the clients to explore data sources and build Power BI dashboards with Azure Data Engineering
- Supporting and collaborating with the other Data Engineers or Data Scientists in the team with technical knowledge
Essential Qualifications :
- Azure Databricks and Synapse experience is mandatory
- Building streaming pipelines on Azure experience is mandatory
- Total 5-7+ years’ experience in Data Engineering is required to apply to this role
- 3 years or more in Azure Data Engineering
- Data analysis, storage, data pipelines, and orchestration
- Expert Python and SQL skills
- Experience working on Big Data
Nice to Have Qualifications
- Experience in data engineering with ML projects
- Experience with data pipeline and workflow management tools eg. Airflow, Jenkins etc.
- Experience working with Spark / Hive / HDFS
- Experience in building strong Power BI Dashboards with DAX queries, Power Apps, Power Automate, and Logic Apps
Senior Data Engineer to design and implement data ingestion pipelines from multiple sources using Azure Databricks- 74443-1
Design and Develop custom ETL Solutions to ingest data into Azure Data Warehouse. Code data quality and transformation logic for data movement within data warehouse. Proven experience with Miscrosoft Azure platform: Databricks/Python/Spark/SparkSQL and ADF. Develop code to publish data from data war...
Sr. Engineering Manager, Core Replication & Storage
The engineering Core team works closely across multiple functions at Redpanda and our work directly drives key business metrics through various SaaS and self-managed offerings. Work with and guide a distributed engineering team that is solving highly unique and complex problems in distributed consen...
Azure Data Engineer with PySpark and Databrick
Azure Data Engineer with PySpark and Databricks. Azure Data Engineer with PySpark and Databricks experience. Strong understanding in the modern data lake paradigm and data life cycle,. Strong experience in performance tuning in Spark and SQL,. ...
Sr. Manager Endpoint Security Engineering & Deployment
Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capit...
Sales Enablement and Data Research Specialist
Diversity, equity, and inclusion - we are committed to creating a diverse, equitable, and inclusive workplace and welcome candidates who share this commitment. Conduct thorough research and analysis to identify market trends, customer behavior, and competitive landscape. Collect and analyze sales da...
2024 Internship Program - AI & Data Engineering
We lead applied data science projects to support contact centre operations, sales, marketing, media, and more! Bell's forward-thinking AI & Data Engineering team is helping create the ultimate service experience for our residential, wireless and small business consumers. Are you looking for a great ...
Manager Azure Data Engineering
Lead technical teams on client engagements leveraging the Azure Stack in the Public Sector •Use your sound business acumen to translate business requirements into technical solutions •Analyze current business practices, processes and procedures to spot future opportunities •Create the building block...
Data Governance and Quality Specialist
Data Governance: Support with the implementation of the enterprise-wide data governance processes / tools including data community engagement, issue/change resolution, data access / sharing, and data decision making, while also incorporating data privacy, data protection, and data risk aspects. Data...
Sr. Specialist, Multi-Unit Servicing and Default Mgmt
Ensure that multi-unit project analyses and recommendations provide cost-effective options within CMHC’s risk appetite to resolve payment defaults and contract breaches, and handle claim adjudication and payment. We’re committed to employment equity and encourage women, Indigenous Peoples, persons w...
Specialist, Data and Information
Select the link below to be transferred from the PSC's GC Jobs Web site and be directed to the new Web site. ...