Talent.com
Data Engineering Specialist - Azure
Data Engineering Specialist - AzureCGI • Halifax, Canada
Data Engineering Specialist - Azure

Data Engineering Specialist - Azure

CGI • Halifax, Canada
4 days ago
Job type
  • Full-time
Job description

Position Description :

We are seeking an experienced Data Engineer with 7+ years of professional expertise in designing, developing, and optimizing large-scale data pipelines and data processing systems. The ideal candidate is highly skilled in Python, PySpark, ETL development, and modern cloud data engineering tools, particularly Databricks and Azure Data Factory (ADF). Experience in data ingestion, transformation, and extraction workflows is essential. Knowledge of Wealth Management domain data is a strong plus.

Your future duties and responsibilities :

  • Design, build, and maintain scalable and robust data pipelines to support data ingestion, transformation, and analytics needs.
  • Develop ETL / ELT processes using Python, PySpark, Databricks, and cloud-native tools.
  • Build and optimize data ingestion frameworks from multiple structured and unstructured data sources.
  • Implement and maintain data processing workflows in Azure Data Factory.
  • Work with Databricks notebooks and clusters to process large datasets efficiently.
  • Ensure data quality, consistency, and governance across data pipelines.
  • Collaborate with cross-functional teams including Data Analysts, BI Developers, and Data Scientists.
  • Troubleshoot and optimize existing data workflows for performance and cost efficiency.
  • Participate in solution design discussions, providing data engineering expertise.
  • Document pipeline architecture, data flows, and technical processes.

Required qualifications to be successful in this role :

  • 7+ years of professional experience as a Data Engineer or in a similar role.
  • Strong proficiency in Python for data transformation and automation.
  • Hands-on experience with PySpark for distributed data processing.
  • Proven expertise in developing and managing ETL pipelines.
  • Practical experience using Databricks for big data processing and analytics.
  • Hands-on experience with Azure Data Factory for pipeline orchestration and workflow management.
  • Solid understanding of data ingestion, extraction, and transformation techniques.
  • Experience working with Azure cloud ecosystems and data services.
  • Strong problem solving skills and the ability to optimize complex data workflows
  • Preferred / Good-to-Have Skills

  • Wealth Management domain experience, including familiarity with financial instruments, transactions, or client reporting datasets.
  • Experience with Delta Lake, Lakehouse architectures, or Azure Synapse.
  • Knowledge of SQL optimization and performance tuning.
  • Understanding of data governance, security, and compliance best practices
  • CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $60,.00 – $,.00. This role is an existing vacancy.

    #LI - OA1

    Use of the term ‘engineering’ in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions, but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

    Skills :
  • English
  • ETL
  • Python
  • Create a job alert for this search

    Data Engineering Specialist Azure • Halifax, Canada

    Similar jobs
    Data Science Manager

    Data Science Manager

    Harnham • Halifax, Nova Scotia, Canada
    Full-time
    We’re partnering with a high-growth product company to hire a Data Science Manager to both ship production ML systems and build a high-performing team. This is a true player-coach role : you’ll stay ...Show more
    Last updated: 1 day ago • Promoted
    Data Scientist - Skills Alliance

    Data Scientist - Skills Alliance

    Skills Alliance • dartmouth, ns, ca
    Full-time
    Stroke Recovery | Neuromodulation | Clinical Neural Data.Up to quarterly travel to Seattle clinical site.Competitive and aligned to experience, location, and mission alignment.Our client is a clini...Show more
    Last updated: 2 days ago • Promoted
    Kronos Consultant - Envision Technology Solutions

    Kronos Consultant - Envision Technology Solutions

    Envision Technology Solutions • dartmouth, ns, ca
    Full-time
    Role Descriptions : At least 5 years of experience in design| implementation and configuring Kronos Workforce Central (WFC) application. Experience in Kronos WFC version 8.Workforce Timekeeper| Workf...Show more
    Last updated: 2 days ago • Promoted
    VMS Implementation Consultant - Contingent Workforce Solutions

    VMS Implementation Consultant - Contingent Workforce Solutions

    SimplifyVMS • dartmouth, NS, ca
    Full-time
    About SimplifyVMS SimplifyVMS is a leading VMS platform , providing cutting-edge Vendor Management System (VMS) s...Show more
    Last updated: 30+ days ago • Promoted
    Technical Lead

    Technical Lead

    Anime Universe • Dartmouth, Nova Scotia, Canada
    Full-time
    Minimum commitment : 20 hours per week.A Technical Lead provides technical direction and oversight for software projects, ensuring solutions are scalable, secure, and aligned with business objective...Show more
    Last updated: 7 days ago • Promoted
    Senior Clinical Data Manager

    Senior Clinical Data Manager

    Warman O'Brien • Halifax, Nova Scotia, Canada
    Permanent
    Senior Lead Clinical Data Manager | CRO - FSP |.Take your Clinical Data Management career to the next level! Join a global, innovative CRO and lead high-impact clinical studies while shaping data s...Show more
    Last updated: 1 day ago • Promoted
    Senior Statistical Analyst II

    Senior Statistical Analyst II

    Tigermed • halifax, NS, ca
    Full-time
    Key Responsibilities Develop and validate complex analysis datasets (ADaM) and TFLs using SAS.Write and review ...Show more
    Last updated: 7 days ago • Promoted
    Remote Senior SQL Engineer - AI Trainer

    Remote Senior SQL Engineer - AI Trainer

    SuperAnnotate • Fall River, Nova Scotia, CA
    Remote
    Full-time
    As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...Show more
    Last updated: 30+ days ago
    Information Technology Private Tutoring Jobs Duncans Cove

    Information Technology Private Tutoring Jobs Duncans Cove

    Superprof • Duncans Cove, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Snowflake Cortex expert - Amaris Consulting

    Snowflake Cortex expert - Amaris Consulting

    Amaris Consulting • halifax, ns, ca
    Full-time
    Snowflake Cortex & Snowpark Specialist.AI-driven solutions within the Snowflake Data Cloud.You will work closely with Data Engineering, Architecture, and Business teams to build scalable pipelines,...Show more
    Last updated: 2 days ago • Promoted
    Associate Vice President of Data & Analytics - Tundra Technical Solutions

    Associate Vice President of Data & Analytics - Tundra Technical Solutions

    Tundra Technical Solutions • halifax, ns, ca
    Full-time
    Associate Vice President of Data & Analytics.About Tundra Technical Solutions.Since 2004, Tundra's mission to become the world's number one choice for top talent has been relentless.As we thrive in...Show more
    Last updated: 2 days ago • Promoted
    Enterprise Resources Planning Specialist

    Enterprise Resources Planning Specialist

    K9 Recruitment • Halifax, Nova Scotia, Canada
    Full-time
    Technical Project Manager / Solutions Consultant — Epicor ERP.We are seeking a Technical Project Manager / Solutions Consultant to join a growing Epicor ERP partner organization.This is a client-fa...Show more
    Last updated: 16 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BET99 • dartmouth, ns, ca
    Full-time
    BET99 is Canada's Premiere Online Sportsbook and Casino.Launched in 2020, we have consistently innovated the online gaming landscape every step of the way, exponentially growing our customer base a...Show more
    Last updated: 1 day ago • Promoted
    Senior Marketing Data Scientist

    Senior Marketing Data Scientist

    Evalueserve • halifax, NS, ca
    Full-time
    Job Summary This role supports a major retail client by developing advanced marketing analytics and data science solutions to optimize media investments and drive busine...Show more
    Last updated: 16 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Set 2 Close | B Corp • dartmouth, NS, ca
    Full-time
    Our client is hiring an Full Stack Developer to support internal software development initiatives.The ideal candidate brings strong backend development experience, solid database...Show more
    Last updated: 24 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Luxoft • halifax, NS, ca
    Full-time
    Project Description : Our Customer is one of the worlds largest investment management companies.Based in Southern California, our client manages close to $2 trillion in a...Show more
    Last updated: 7 days ago • Promoted
    Operations Specialist

    Operations Specialist

    Accelerant • Dartmouth, Nova Scotia, Canada
    Full-time
    We are seeking a detail-oriented and proactive Operations Specialist to join our growing Operations team.This role is critical in ensuring smooth and efficient management of our operational workflo...Show more
    Last updated: 2 days ago • Promoted
    Customer Support Specialist - ExaCare AI

    Customer Support Specialist - ExaCare AI

    ExaCare AI • dartmouth, ns, ca
    Full-time
    ExaCare AI is a leading health tech company on a mission to build the AI operating system for post-acute care.Our platform turns messy, unstructured hospital referral packets into clear clinical in...Show more
    Last updated: 30+ days ago • Promoted