Talent.com
Senior Data Engineer
Senior Data Engineerfreelance.ca • Ottawa, Canada
Senior Data Engineer

Senior Data Engineer

freelance.ca • Ottawa, Canada
11 days ago
Job type
  • Full-time
Job description

About the Project The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the best results for our clients. About the Responsibilities

  • Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
  • Experience in developing and proposing design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
  • Experienced collaboration working with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements.
  • Increase the overall speed in which data is onboarded to the Data and Analytics platform.
  • Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform.
  • Increase the overall quality of data pipeline development through DevSecOps.

About the Qualifications

  • Programming experience in Spark using modern languages such as Python, Scala
  • Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
  • Experience leading Data Engineering principles within an organization / team.
  • Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
  • Knowledge and expertise of database modeling techniques : Data Vaults, Star, Snowflake, 3NF, etc.
  • Experience working with streaming data architecture and technologies for real-time : Spark Streaming, Kafka, Flink, Storm
  • Experience working with relational and non-relational database technologies : SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
  • Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus
  • Assets

  • Experience within Azure environment
  • Strong Python, Scala and Spark experience
  • Experience modernizing data platforms.
  • Experience with Azure Functions and C#
  • 2 to 3 projects developing Data Vault
  • Candidates must outline in detail how they meet the above requirements. Pay Disclosure The average hourly pay range for this field is as follows :

  • Junior : 0–5 years of experience - $40-75 / hr
  • Intermediate : 6–9 years of experience - $60-100 / hr
  • Senior : 10+ years of experience - $90-150 / hr
  • Compensation is commensurate with these standards; exceptions may apply based on experience, skills, and market conditions. AI Disclosure We may use artificial intelligence (AI) or other automated tools to support parts of our recruitment process. No automated tools make hiring decisions.

    Create a job alert for this search

    Senior Data Engineer • Ottawa, Canada

    Similar jobs
    Senior QA Automation Engineer – Data Pipelines (Remote)

    Senior QA Automation Engineer – Data Pipelines (Remote)

    Solink Corp. • Ottawa H2B, ON, Canada
    Remote
    Full-time
    A tech innovation firm is seeking a Senior QA Automation Engineer to take a leadership role in building automated tests for data integrations and infrastructure. Responsibilities include defining te...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Scientist, Power Systems Analytics

    Senior Data Scientist, Power Systems Analytics

    Hydroone • Ottawa H2B, ON, Canada
    Full-time
    A leading electricity provider in Ontario is seeking an experienced Data Scientist to join their team.The role involves leading data science practices, performing analysis on operational data, and ...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer - Integrations & Cloud Platforms

    Senior Data Engineer - Integrations & Cloud Platforms

    Groupe Nordik • Outaouais
    Full-time
    A leading wellness company in Outaouais is seeking a Senior Developer (Level 3) specializing in data and integrations.This role focuses on backend systems, data pipelines, and database-driven appli...Show more
    Last updated: 4 days ago • Promoted
    R&D Materials Data Engineer II

    R&D Materials Data Engineer II

    Synopsys, Inc. • Ottawa
    Full-time
    A leading technology company in Ottawa seeks a passionate engineer to develop materials data products that enhance engineering education and simulation. The ideal candidate has a degree in materials...Show more
    Last updated: 4 days ago • Promoted
    Analytics Engineer – Customer Journey (Ottawa Based)

    Analytics Engineer – Customer Journey (Ottawa Based)

    Noibu • Ottawa
    Full-time
    Noibu is the leading ecommerce monitoring and experience analytics platform, trusted by global brands to protect and grow online revenue. Monitoring websites 24 / 7, Noibu identifies critical site err...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Go Engineer - Cloud / Kubernetes & AI Integrations

    Senior Go Engineer - Cloud / Kubernetes & AI Integrations

    Flexera • Ottawa
    Full-time
    A leading technology solutions provider in Ottawa is seeking a talented Senior Software Engineer to join their platform team. The ideal candidate will have extensive experience in Go programming, a ...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Launch Potato • Ottawa
    Full-time
    As The Discovery and Conversion Company, our mission is to connect consumers with the world’s leading brands through data-driven content and technology. Headquartered in South Florida with a remote-...Show more
    Last updated: 4 days ago • Promoted
    Senior Software Engineer I

    Senior Software Engineer I

    SurveyMonkey • Ottawa H2B, ON, Canada
    Remote
    Full-time
    SurveyMonkey is the world’s most popular platform for surveys and forms, built for business—loved by users.We combine powerful capabilities with intuitive design, effectively serving every use case...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Cloud-Native Satellite Platform

    Senior Software Engineer - Cloud-Native Satellite Platform

    Telesat • Ottawa H2B, ON, Canada
    Full-time
    A leading global satellite operator is seeking a Senior Software Engineer to develop applications for the Lightspeed System. The candidate should have at least 10 years of experience in software dev...Show more
    Last updated: 11 days ago • Promoted
    Remote Data Architect - Modernize Enterprise Data

    Remote Data Architect - Modernize Enterprise Data

    Orangutech • Ottawa H2B, ON, Canada
    Remote
    Part-time
    A public service organization is seeking an experienced Database Architect for a future opportunity.This role focuses on leading assessments and modernizing the enterprise data ecosystem.Candidates...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Global Talent Alliance, Canada • Ottawa H2B, ON, Canada
    Full-time
    Senior Software Engineer to work on their Zero Trust products and cloud services.The individual will become a member tasked with the development of innovative solutions to protect endpoints from em...Show more
    Last updated: 26 days ago • Promoted
    Senior Platform Engineer : Cloud Infra & Data Pipelines

    Senior Platform Engineer : Cloud Infra & Data Pipelines

    BlackBerry • Ottawa
    Full-time
    A technology company in Ottawa is seeking a DevOps Engineer to enhance their IoT platform's capabilities.The role requires 5+ years of experience in DevOps, with a strong focus on Kubernetes and Je...Show more
    Last updated: 4 days ago • Promoted
    Senior Python Engineer - Analytics Platform (ELK / K8s)

    Senior Python Engineer - Analytics Platform (ELK / K8s)

    Aptiv PLC • Ottawa
    Full-time
    A leading technology company located in Ottawa, Canada, seeks an experienced software engineer to develop analytics features and contribute to high-quality code delivery. Candidates should have over...Show more
    Last updated: 4 days ago • Promoted
    Hybrid Grid Modernization Engineer | Data Analytics Lead

    Hybrid Grid Modernization Engineer | Data Analytics Lead

    Hydro Ottawa • Ottawa
    Full-time
    A leading utility company in Ottawa is seeking a Grid Modernization Engineer to lead the operational aspects of grid modernization efforts. The ideal candidate will oversee the implementation of new...Show more
    Last updated: 2 days ago • Promoted
    Senior Snowflake Data Architect for AI & Analytics

    Senior Snowflake Data Architect for AI & Analytics

    EY • Ottawa
    Full-time
    A leading professional services firm in Ottawa is seeking an experienced Snowflake Data Architect to lead technical solutions on the Snowflake platform. The role requires 8+ years of experience in d...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, AI-Powered Cloud Cost Optimization

    Senior Software Engineer, AI-Powered Cloud Cost Optimization

    Frugal • Ottawa H2B, ON, Canada
    Remote
    Full-time
    A pioneering SaaS startup in Ottawa, ON, seeks a Senior Software Engineer to drive critical platform development and mentor teams. You'll tackle complex challenges from design to deployment while en...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer Co‑op : Build Reliable Data Pipelines

    Data Engineer Co‑op : Build Reliable Data Pipelines

    RVezy group • Ottawa
    Full-time
    An innovative travel platform is seeking a Data Engineer Co-op Student to work on data pipelines and quality assurance.This role requires full-time attendance in the office and is perfect for a uni...Show more
    Last updated: 4 days ago • Promoted
    IoT Software Engineer – Gateway & Cloud Data

    IoT Software Engineer – Gateway & Cloud Data

    Giatec • Ottawa
    Full-time
    A leading construction technology firm located in Ottawa, Ontario is seeking a Software Developer to design and maintain application architectures for their IoT gateway. The ideal candidate will hav...Show more
    Last updated: 4 days ago • Promoted