Talent.com
Sr. Data Engineer to lead the delivery of data on data and analytics platform
Sr. Data Engineer to lead the delivery of data on data and analytics platformS.i. Systems • Calgary
Sr. Data Engineer to lead the delivery of data on data and analytics platform

Sr. Data Engineer to lead the delivery of data on data and analytics platform

S.i. Systems • Calgary
30+ days ago
Job type
  • Full-time
Job description

Our valued client is looking for a Sr. Data Engineer to lead the delivery of data on data and analytics platform .

This is a Remote position (Eastern Time Zone).

The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies.

Tasks include :

  • Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
  • Develop and propose design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
  • Collaborate and work with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements
  • Increase the overall speed in which data is onboarded to the Data and Analytics platform.
  • Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
  • Increase the overall quality of data pipeline development through DevSecOps

Must have :

  • Eligible for Reliability clearance
  • Experience in leading, designing, implementing, and collaborating with stakeholders
  • Programming experience in Spark using modern languages such as Python, Scala
  • Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
  • Experience leading Data Engineering principles within an organization / team
  • Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
  • Knowledge and expertise of database modeling techniques : Data Vaults, Star, Snowflake, 3NF, etc.
  • Experience working with streaming data architecture and technologies for real-time : Spark Streaming, Kafka, Flink, Storm
  • Experience working with relational and non-relational database technologies : SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
  • Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus
  • Nice to have :

  • Experience within Azure environment
  • Strong Python, Scala and Spark experience
  • Experience modernizing data platforms.
  • Experience with Azure Functions and C#
  • 2 to 3 projects developing Data Vault
  • Create a job alert for this search

    Lead Data Engineer • Calgary

    Similar jobs
    Cloud Platforms & Data Lead - AI, BigQuery & Analytics

    Cloud Platforms & Data Lead - AI, BigQuery & Analytics

    Windmill Microlending • Calgary
    Full-time
    A leading charity organization in Calgary is seeking a Cloud Platforms & Data Lead to advance their cloud and data initiatives while managing a technical team. The role requires extensive experience...Show more
    Last updated: 28 days ago • Promoted
    Data Engineer : Azure Pipelines & Hybrid Cloud

    Data Engineer : Azure Pipelines & Hybrid Cloud

    Squadric • Calgary
    Full-time
    A leading technology firm is seeking an Intermediate Data Engineer in Calgary, Alberta.This role provides an opportunity to design and maintain robust data pipelines across hybrid environments, col...Show more
    Last updated: 8 days ago • Promoted
    Technology Lead - Senior Power BI, Data Engineer

    Technology Lead - Senior Power BI, Data Engineer

    Infosys Limited • Calgary
    Full-time
    Technology Lead - Senior Power BI, Data Engineer.Infosys is seeking a Technology Lead - Power BI.This position will interface with key stakeholders and apply technical proficiency across different ...Show more
    Last updated: 8 days ago • Promoted
    Thermal Data Integration Engineer : Real-Time Analytics

    Thermal Data Integration Engineer : Real-Time Analytics

    Canadian Natural Resources Limited (CNRL) • Calgary
    Full-time
    A leading energy company in Calgary is seeking a Thermal Data Integration Engineer.This full-time temporary role involves working within a dynamic team to develop data-driven solutions to enhance p...Show more
    Last updated: 8 days ago • Promoted
    Technology Lead - Senior Power BI, Data Engineer

    Technology Lead - Senior Power BI, Data Engineer

    Infosys • Calgary
    Full-time
    Technology Lead - Senior Power BI, Data Engineer.Infosys is seeking a Technology Lead - Power BI.This position will interface with key stakeholders and apply technical proficiency across different ...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Sage Recruiting • Calgary, AB, Canada
    Full-time
    Our client is a well-established energy analytics company that has achieved product-market fit and is now in a growth phase. They are a data-first organization.Data is not a support function here; i...Show more
    Last updated: 18 days ago • Promoted
    Senior Data & Analytics Engineer

    Senior Data & Analytics Engineer

    Wagepoint • Calgary
    Full-time
    Senior Data & Analytics Engineer.Job function : Information Technology.Industry : Software Development.At Wagepoint, we’re good people. But that’s only because Wagepointers bring the best versions of ...Show more
    Last updated: 8 days ago • Promoted
    Data Integration Engineer

    Data Integration Engineer

    BigGeo Inc. • Calgary
    Full-time
    Employers often ask why you'd be a good fit to work for them.We prefer to start by showing why we’d be a great fit for you. BigGeo is redefining geospatial intelligence with an AI-ready Discrete Glo...Show more
    Last updated: 8 days ago • Promoted
    Data Science Engineer — ML Pipelines & Production

    Data Science Engineer — ML Pipelines & Production

    ARC Resources Ltd. • Calgary
    Full-time
    A leading Canadian energy company in Calgary is seeking a Data Science Engineer / Developer for their Data Analytics team. This role involves designing predictive models, maintaining ML pipelines, and...Show more
    Last updated: 8 days ago • Promoted
    Sr. Associate, Data & Analytics

    Sr. Associate, Data & Analytics

    RSM Canada • Calgary
    Full-time
    We are the leading provider of professional services to the middle market globally, our purpose is to instill confidence in a world of change, empowering our clients and people to realize their ful...Show more
    Last updated: 28 days ago • Promoted
    Senior Data Engineer, Integrations - Data Pipelines Hybrid

    Senior Data Engineer, Integrations - Data Pipelines Hybrid

    Clio • Calgary
    Full-time
    A leading legal technology company is seeking a Senior Data Engineer to join its growing team in Calgary.The role involves implementing data ingestion techniques, designing data pipelines, and coll...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    E-Solutions • Airdrie, Alberta, Canada
    Full-time
    Experience in Data engineering skills with ADF, Azure Data bricks, Spark, Synapse engineering, Data Engineering Projects with Data Ingestion and Transformation Pipeline development.Experience with ...Show more
    Last updated: 3 hours ago • Promoted • New!
    OT Data Engineer : Cloud Pipelines & Data Lakes

    OT Data Engineer : Cloud Pipelines & Data Lakes

    KZenEdge Strategic Program Execution • Calgary
    Full-time
    A leading energy sector firm in Calgary seeks a skilled Data Engineer to design and maintain data infrastructure for critical operations. The role involves developing data pipelines, optimizing data...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer - AI Personalization & Real-Time Customer Data

    Senior Data Engineer - AI Personalization & Real-Time Customer Data

    TELUS • Calgary
    Full-time
    The AI Products and Platform (AIPP) team builds the foundational capabilities that enable AI-driven personalization, decisioning, and real-time customer experiences at scale.Our work supports intel...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Targeted Talent • Calgary, AB, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is completely remote! Our client is a global enterprise company with a product that you've likely used.Within this role, you&...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Mastech Digital • Calgary, Alberta, Canada
    Full-time
    This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company.Watch and monitor data systems. Investigate and fix data problems.Work closely wi...Show more
    Last updated: 5 hours ago • Promoted • New!
    Principal Data Engineer / Technical Lead

    Principal Data Engineer / Technical Lead

    Symend • Calgary, AB, CA
    Full-time
    Quick Apply
    The Principal Data Engineer / Technical Lead is a role that requires technical depth, exceptional project strategy and strong communication skills. We’re looking for a Principal Data Engineer wh...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    MNP • Calgary
    Full-time
    Join to apply for the Data Engineer role at MNP.Inspirational, innovative and entrepreneurial – this is how we describe our empowered teams. Combine your passion with purpose and join a culture that...Show more
    Last updated: 8 days ago • Promoted