Talent.com
Data Engineer Azure
Data Engineer AzureCGI • Halifax, Nova Scotia, Canada
Data Engineer Azure

Data Engineer Azure

CGI • Halifax, Nova Scotia, Canada
9 days ago
Job type
  • Full-time
Job description

Position Description :

We are seeking an experienced Data Engineer with 7 years of professional expertise in designing developing and optimizing large-scale data pipelines and data processing systems. The ideal candidate is highly skilled in Python PySpark ETL development and modern cloud data engineering tools particularly Databricks and Azure Data Factory (ADF). Experience in data ingestion transformation and extraction workflows is essential. Knowledge of Wealth Management domain data is a strong plus.

Your future duties and responsibilities :

Design build and maintain scalable and robust data pipelines to support data ingestion transformation and analytics needs.

Develop ETL / ELT processes using Python PySpark Databricks and cloud-native tools.

Build and optimize data ingestion frameworks from multiple structured and unstructured data sources.

Implement and maintain data processing workflows in Azure Data Factory.

Work with Databricks notebooks and clusters to process large datasets efficiently.

Ensure data quality consistency and governance across data pipelines.

Collaborate with cross-functional teams including Data Analysts BI Developers and Data Scientists.

Troubleshoot and optimize existing data workflows for performance and cost efficiency.

Participate in solution design discussions providing data engineering expertise.

Document pipeline architecture data flows and technical processes.

Required qualifications to be successful in this role :

7 years of professional experience as a Data Engineer or in a similar role.

Strong proficiency in Python for data transformation and automation.

Hands-on experience with PySpark for distributed data processing.

Proven expertise in developing and managing ETL pipelines.

Practical experience using Databricks for big data processing and analytics.

Hands-on experience with Azure Data Factory for pipeline orchestration and workflow management.

Solid understanding of data ingestion extraction and transformation techniques.

Experience working with Azure cloud ecosystems and data services.

Strong problem solving skills and the ability to optimize complex data workflows

Preferred / Good-to-Have Skills

Wealth Management domain experience including familiarity with financial instruments transactions or client reporting datasets.

Experience with Delta Lake Lakehouse architectures or Azure Synapse.

Knowledge of SQL optimization and performance tuning.

Understanding of data governance security and compliance best practices

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $60000.00 $120000.00. This role is an existing vacancy.

#LI - OA1

Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

Skills : English

ETL

Python

What you can expect from us :

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.

To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our teamone of the largest IT and business consulting services firms in the world.

Required Experience :

IC

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1

Monthly Salary Salary : 60000 - 120000

Create a job alert for this search

Data Engineer Azure • Halifax, Nova Scotia, Canada

Similar jobs
Senior Analytics Engineer - TekRek

Senior Analytics Engineer - TekRek

TekRek • dartmouth, ns, ca
Full-time
TekRek has partnered with a fast growing firm specializing in AI enablement and data optimization.Our client works with some of the top tier technology firms in Silcom Valley.With rapid growth and ...Show more
Last updated: 30+ days ago • Promoted
Cybersecurity Consultant – Azure & AI Governance ((French Bilingual) - halifax

Cybersecurity Consultant – Azure & AI Governance ((French Bilingual) - halifax

Concentrix • halifax, ns, ca
Full-time
Cybersecurity Consultant – Azure & AI Governance.Microsoft ecosystem to advise enterprise customers and lead strategic AI security initiatives. Lead customer workshops to assess AI readiness, focusi...Show more
Last updated: 19 days ago • Promoted
Customer Service Agent - 50k-60k / Year - Remote

Customer Service Agent - 50k-60k / Year - Remote

Spade Recruiting • East Hants, Nova Scotia
Remote
Full-time
Quick Apply
We’re looking for enthusiastic, self-driven, individuals to assist existing and prospective clients within our organization. This position will work with multiple clients throughout the day pr...Show more
Last updated: 9 days ago • Promoted
Technical Writer

Technical Writer

NLB Services • halifax, NS, ca
Full-time
Mandatory Skills & Experience • 3–5 years of experience in technical writing or technical documentation, preferably in IT, infrastructure, or enterprise technology environment...Show more
Last updated: 10 days ago • Promoted
Remote Senior SQL Engineer - AI Trainer

Remote Senior SQL Engineer - AI Trainer

SuperAnnotate • Dartmouth, Nova Scotia, CA
Remote
Full-time
As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...Show more
Last updated: 30+ days ago
Contract T4 || Oracle Integration Cloud (OIC)

Contract T4 || Oracle Integration Cloud (OIC)

Ampstek • halifax, NS, ca
Full-time
Role : Oracle Integration Cloud (OIC) Location : Remote (Canada) Mandatory...Show more
Last updated: 2 days ago • Promoted
Senior Full Stack Developer

Senior Full Stack Developer

Site 20 / 20 • halifax, NS, ca
Full-time
Senior Full Stack Developer Job description We’re looking for a Senior Full Stack Developer with deep experience in building modern...Show more
Last updated: 9 days ago • Promoted
Senior Clinical Data Manager - Warman O'Brien

Senior Clinical Data Manager - Warman O'Brien

Warman O'Brien • dartmouth, ns, ca
Full-time
Join a Global Leader in Clinical Research.Are you a seasoned Clinical Data Manager with a passion for driving high-quality data outcomes across global clinical trials? We are looking for a Senior C...Show more
Last updated: 30+ days ago • Promoted
Data Quality Analyst

Data Quality Analyst

Collabera • Halifax, NS, Canada
Full-time
This is with one of our Banking client.We are seeking a Data Quality Analyst with strong expertise in data profiling, rule design, and analysis to support enterprise-wide data governance and report...Show more
Last updated: 7 days ago • Promoted
Data Reporting Analyst - halifax

Data Reporting Analyst - halifax

Groupe Lemur, Inc • halifax, ns, ca
Full-time
L’analyste, données et rapports joue un rôle clé à l’intersection de la gouvernance des données, de l’intelligence d’affaires et du reporting financier. Le poste est responsable de l’établissement d...Show more
Last updated: 1 day ago • Promoted
Scada Engineer - Akkodis

Scada Engineer - Akkodis

Akkodis • dartmouth, ns, ca
Full-time
EMS / SCADA Engineer – Power Systems.Professional Services Engagement – B2B (Incorporated Entities Only).Akkodis is seeking an EMS / SCADA Engineer – Power Systems for a remote contract position su...Show more
Last updated: 7 days ago • Promoted
Java Software Engineer - halifax

Java Software Engineer - halifax

Luxoft • halifax, ns, ca
Full-time
Building a risk applications and tools for innovative international top-tier hedge fund from the ground up, comprising the systems for traders, pre-trade checks and analysis, risks and limits manag...Show more
Last updated: 15 days ago • Promoted
Workday PATT Architect - Focus on WD

Workday PATT Architect - Focus on WD

Focus on WD • dartmouth, ns, ca
Full-time
This role requries a bilingual candidate and the requried language is French.We are hiring a Senior Manager to lead Workday Payroll, Time Tracking and Absence delivery across complex client program...Show more
Last updated: 25 days ago • Promoted
Inventory Buyer Analyst

Inventory Buyer Analyst

Eastlink • dartmouth, ns, ca
Full-time
Eastlink is a family owned, entrepreneurial and innovative company headquartered in Halifax, Nova Scotia.We take great pride in being a leader in delivering creative competitive, customer focused t...Show more
Last updated: 2 days ago • Promoted
Senior MLOps Engineer | Ingénieur •e MLOps senior - Jesta I.S.

Senior MLOps Engineer | Ingénieur •e MLOps senior - Jesta I.S.

Jesta I.S. • dartmouth, ns, ca
Full-time
Our data environment spans ERP and cloud platforms, and our engineering culture is hands-on, pragmatic, and fast-moving.You’ll work in a production environment that integrates Oracle, Snowflake, an...Show more
Last updated: 1 day ago • Promoted
Customer Success Engineer - BioIntelligence Technologies

Customer Success Engineer - BioIntelligence Technologies

BioIntelligence Technologies • halifax, ns, ca
Full-time
BioIntelligence Technologies started with a simple goal : accelerate access to greener chemicals for families, friends, citizens, and the planet. Today, biotech accounts for 20% of all molecules and ...Show more
Last updated: 30+ days ago • Promoted
Senior Software Engineer - Frugal

Senior Software Engineer - Frugal

Frugal • halifax, ns, ca
Full-time
Frugal is an AI-powered coding agent purpose-built to tackle one of the most persistent problems in tech : runaway cloud costs. Despite years of optimization efforts, cloud expenses remain high—and w...Show more
Last updated: 1 day ago • Promoted
Software Engineer

Software Engineer

Liferaft • NS, CA
Remote
Full-time
Quick Apply
Liferaft is looking for a highly skilled and visionary Software Engineer to contribute to the development of advanced OSINT tools that empower organizations to extract valuable insights from open-s...Show more
Last updated: 10 days ago