Talent.com
Sr. Data Engineer to lead the delivery of data on data and analytics platform
Sr. Data Engineer to lead the delivery of data on data and analytics platformS.i. Systems • Calgary
Sr. Data Engineer to lead the delivery of data on data and analytics platform

Sr. Data Engineer to lead the delivery of data on data and analytics platform

S.i. Systems • Calgary
21 days ago
Job type
  • Full-time
Job description

Our valued client is looking for a Sr. Data Engineer to lead the delivery of data on data and analytics platform .

This is a Remote position (Eastern Time Zone).

The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies.

Tasks include :

  • Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
  • Develop and propose design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
  • Collaborate and work with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements
  • Increase the overall speed in which data is onboarded to the Data and Analytics platform.
  • Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
  • Increase the overall quality of data pipeline development through DevSecOps

Must have :

  • Eligible for Reliability clearance
  • Experience in leading, designing, implementing, and collaborating with stakeholders
  • Programming experience in Spark using modern languages such as Python, Scala
  • Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
  • Experience leading Data Engineering principles within an organization / team
  • Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
  • Knowledge and expertise of database modeling techniques : Data Vaults, Star, Snowflake, 3NF, etc.
  • Experience working with streaming data architecture and technologies for real-time : Spark Streaming, Kafka, Flink, Storm
  • Experience working with relational and non-relational database technologies : SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
  • Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus
  • Nice to have :

  • Experience within Azure environment
  • Strong Python, Scala and Spark experience
  • Experience modernizing data platforms.
  • Experience with Azure Functions and C#
  • 2 to 3 projects developing Data Vault
  • Create a job alert for this search

    Lead Data Engineer • Calgary

    Similar jobs
    Senior Data & Analytics Engineer

    Senior Data & Analytics Engineer

    Wagepoint • Calgary, Alberta, CA
    Full-time
    Quick Apply
    Wagepoint is a small-but-mighty fintech on a mission to make payroll simple (and maybe even delightful).Our online software takes care of the “ugh” stuff — like wage calculations and tax reporting ...Show more
    Last updated: 30+ days ago
    R Engineer

    R Engineer

    SuperAnnotate • Okotoks, Alberta, CA
    Remote
    Full-time
    As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...Show more
    Last updated: 3 days ago
    Senior Data Architect & Strategy Leader

    Senior Data Architect & Strategy Leader

    Infosys Limited • Calgary
    Full-time
    A leading technology services provider in Calgary is seeking a Data Architect to design and manage data architecture.The ideal candidate has at least 8 years of IT experience, particularly in Telec...Show more
    Last updated: 17 days ago • Promoted
    Managed Pressure Drilling (MPD) Engineer Data Analysis Specialist

    Managed Pressure Drilling (MPD) Engineer Data Analysis Specialist

    Citadel Drilling / Opla Energy • Calgary, AB, Canada
    Full-time
    Location : Houston, Texas or Calgary, Alberta.Opla Energy is a leader in the energy industry, providing cutting-edge drilling solutions that enhance operational efficiency and reduce costs.We specia...Show more
    Last updated: 30+ days ago • Promoted
    Swift Engineer

    Swift Engineer

    SuperAnnotate • Okotoks, Alberta, CA
    Remote
    Full-time
    As a remote, hourly paid Swift Engineer, you will review AI-generated responses and generate high-quality Swift and iOS-focused content, evaluating the reasoning quality and step-by-step problem-so...Show more
    Last updated: 3 days ago
    Databricks Solutions Architect — Enterprise Data & AI

    Databricks Solutions Architect — Enterprise Data & AI

    BDO Canada • Calgary
    Full-time
    A leading consulting firm in Calgary is seeking a Senior Databricks Solution Architect.This role involves bridging technology with client partnerships, shaping data and AI strategies, and driving b...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Hays • Calgary, AB, Canada
    Full-time
    Enterprise Security Data Solution Designer / Architect.Must have experience working with PowerBI.Five to 10 years in ETL (extract, load, transform) tools, techniques, data warehousing, and metadata...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Sage Recruiting • Calgary, AB, Canada
    Full-time
    Our client is a well-established energy analytics company that has achieved product-market fit and is now in a growth phase. They are a data-first organization.Data is not a support function here; i...Show more
    Last updated: 7 days ago • Promoted
    Strategic Data Architect for Modernization & Cloud

    Strategic Data Architect for Modernization & Cloud

    Cynet systems Inc • Calgary
    Full-time
    Support architecture and integration teams with database insights and dependencies.Analyze business processes, workflows, and functional requirements across FIS domains. Validate current-state pain ...Show more
    Last updated: 13 days ago • Promoted
    Hybrid Enterprise Architect : AI & Data Platforms

    Hybrid Enterprise Architect : AI & Data Platforms

    People Corporation • Toronto, Calgary
    Full-time
    A leading technology firm is seeking an Enterprise Architect focused on AI, automation, and data platforms.You'll design the enterprise architecture and integrate advanced technologies across the o...Show more
    Last updated: 17 days ago • Promoted
    Director, Data and Analytics

    Director, Data and Analytics

    Calgary Homeless Foundation • Calgary
    Full-time
    Calgary Homeless Foundation is a purpose‑driven systems leader dedicated to creating innovative, coordinated, and lasting pathways out of homelessness. As the central hub for Calgary’s homeless‑serv...Show more
    Last updated: 9 days ago • Promoted
    Senior AI Model-Serving Engineer

    Senior AI Model-Serving Engineer

    Deltek • Calgary
    Full-time
    A prominent software solutions provider is seeking a Senior Software Engineer to design and develop scalable systems serving end users. The role involves using advanced technologies like AWS and Doc...Show more
    Last updated: 17 days ago • Promoted
    Master Data Analyst

    Master Data Analyst

    Hays • Calgary, AB, Canada
    Full-time
    The Supply Chain Master Data Analyst role is responsible for coordinating and performing day-to-day tasks for the creation, maintenance, and data quality improvements of Master Data throughout its ...Show more
    Last updated: 10 days ago • Promoted
    Principal Data Engineer / Technical Lead

    Principal Data Engineer / Technical Lead

    Symend • Calgary, AB, Canada
    Full-time
    The Principal Data Engineer / Technical Lead is a role that requires technical depth, exceptional project strategy and strong communication skills. We’re looking for a Principal Data Engineer wh...Show more
    Last updated: 30+ days ago • Promoted
    2 - Senior Data Engineer

    2 - Senior Data Engineer

    Targeted Talent • Calgary, AB, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Data Analytics Intern

    Data Analytics Intern

    SalesPilot 365 | CRM • calgary, ab, ca
    Full-time
    As part of our expansion into Data Analytics, we’re offering a structured internship program for motivated individuals eager to build a career in data-driven decision-making.Join our analytics team...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Targeted Talent • Calgary, AB, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is completely remote! Our client is a global enterprise company with a product that you've likely used.Within this role, you&...Show more
    Last updated: 30+ days ago • Promoted
    Data Analytics Intern - SalesPilot 365 | CRM

    Data Analytics Intern - SalesPilot 365 | CRM

    SalesPilot 365 | CRM • calgary, ab, ca
    Full-time
    As part of our expansion into Data Analytics, we’re offering a structured internship program for motivated individuals eager to build a career in data-driven decision-making.Join our analytics team...Show more
    Last updated: 21 days ago • Promoted