Position Description :
This role can be situated within proximity to a CGI office
Are you an experienced Azure Data Engineering professional interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients? Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to create a robust data engineering infrastructure to sort that mess out? If you have that technical expertise of building pipelines and enabling data engineering or ETL in organizations, a genuine flair for solving problems, and the mindset to collaborate with diverse clients and team members alike, we're looking for you.
- Expertise in Azure Databricks and Synapse experience is mandatory for this role
Your future duties and responsibilities :
Delivering on areas of data preparation and transformations and ETL or ELT development on Azure - Azure Data Factory (ADF), Synapse, Azure Databricks, Azure Data Lake (ADLS), Azure SQL database, Azure SQL DatawarehouseBuilding Streaming Data pipelines with DatabricksWorking in a business environment with large-scale, complex and big data datasets and dispersed data sourcesUsing SQL or Advanced SQL and Python skills as necessaryGathering client requirements, coding and building Data Engineering pipelines in AzureImplementing proof of concepts to show value and then package and scale to full data engineering scale on both on-prem and cloud environmentsStrategically collaborating with the clients to explore data sources and build Power BI dashboards with Azure Data EngineeringSupporting and collaborating with the other Data Engineers or Data Scientists in the team with technical knowledgeRequired qualifications to be successful in this role :
Azure Databricks and Synapse experience is mandatoryBuilding streaming pipelines on Azure experience is mandatoryTotal 5-7+ years’ experience in Data Engineering is required to apply to this role3 years or more in Azure Data EngineeringData analysis, storage, data pipelines, and orchestrationExpert Python and SQL skillsExperience working on Big DataNice to Have Qualifications
Experience in data engineering with ML projectsExperience with data pipeline and workflow management tools eg. Airflow, Jenkins etc.Experience working with Spark / Hive / HDFSExperience in building strong Power BI Dashboards with DAX queries, Power Apps, Power Automate, and Logic AppsSkills :
Azure Data Lake