Talent.com
Data Engineer
Data EngineerCB Canada • North Vancouver, British Columbia, Canada
Data Engineer

Data Engineer

CB Canada • North Vancouver, British Columbia, Canada
30+ days ago
Job type
  • Full-time
Job description

Data Engineer

On behalf of our client, Procom Consultants Group is currently looking for an Intermediate Data Engineer.

Requested resources to provide developer expertise on coding of data transformation pipelines and systems integration tasks relating to enterprise data management applications that span across different business areas and platforms.

Data Engineer Job Details

  • Creating mapping documentation of data elements from source to target and liaising with other Data Engineers, Data Architects and SMEs.
  • Developing & testing Data Transformation pipelines by leveraging the latest Big Data tools and technologies
  • Collaborate with upstream data teams, develop data validation and test plans, performing user acceptance testing, and provide feedback to development and sustainment teams
  • Conducting analysis for moderate to complex data requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
  • Act as a lead developer to implement code changes in various environments and platforms leveraging our DevOps & DataOps
  • Work closely with the testing team to assist with issues raised in user acceptance testing (UAT) and Business Value Testing (BVT)

Deliverables :

Fully implement the new data format across all IM supported platforms including

Big Data (Hadoop), Enterprise Data Warehouse (EDW) and Operational Data Store

(ODS)

Data Engineer Mandatory Skills

Communication & Problem Solving Skills :

  • Communicating & presenting solutions to internal developers
  • Ability to apply critical thinking skills to develop efficient code, data transformation logic and solution design
  • Experience and / or understanding of Agile Methodologies
  • Technical Skills :

  • Advanced Database Skills & SQL
  • Experience with or exposure to Big Data platforms, ideally exposure to Hadoop ecosystem (HDFS, Apache Hive, Apache Spark, SparkSQL)
  • Extensive programming experience in either Java, C++ or preferably Scala, IntelliJ, Jenkins
  • Working experience with Apache Spark Data Processing Framework, Parquet data format
  • Good understanding of Relational (Oracle / DB2) and Hadoop Big Data platforms
  • Experience working with Jira
  • Data Engineer Start Date

    Oct 24, 2022

    Data Engineer Assignment Duration

    March 31 2023

    Data Engineer  Working Location

    Fully remote but PST hours

    Create a job alert for this search

    Data Engineer • North Vancouver, British Columbia, Canada

    Similar jobs
    Senior Data Engineer - Real-Time & Analytics (Web3)

    Senior Data Engineer - Real-Time & Analytics (Web3)

    LayerZero • Vancouver
    Full-time
    A cutting-edge technology firm in Vancouver is looking for a Data Engineer to design and maintain robust data infrastructure for cross-chain applications. You will develop data pipelines, ensure dat...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer – Observability, DataOps & Snowflake

    Senior Data Engineer – Observability, DataOps & Snowflake

    lululemon • Vancouver
    Full-time
    A leading performance apparel company in Vancouver is looking for a Senior Engineer I to lead technology development and mentor a team. This role emphasizes the importance of DataOps principles, obs...Show more
    Last updated: 12 days ago • Promoted
    Data Infrastructure Engineer — Build AI Data Pipelines

    Data Infrastructure Engineer — Build AI Data Pipelines

    Speechify • Vancouver
    Full-time
    A fast-growing tech firm in Vancouver is seeking a skilled software developer to enhance our backend services, focusing on cloud infrastructure and data processing. The ideal candidate has 5+ years ...Show more
    Last updated: 19 days ago • Promoted
    Hybrid Data Cloud Platform Engineer

    Hybrid Data Cloud Platform Engineer

    Padlandscape • Vancouver
    Full-time
    A leading gaming solutions supplier is seeking a Data Cloud Platform Engineer (DBA) in Vancouver.The role involves managing AWS databases, ensuring high availability, security, and performance, whi...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer Backend (Vancouver)

    Senior Data Engineer Backend (Vancouver)

    Flagler Health • Vancouver
    Full-time
    Flagler Health is a fast-growing healthtech company transforming how healthcare organizations deliver care through AI-powered workflow automation, remote patient engagement, and chronic care progra...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    INTELLISWIFT INC • Burnaby
    Full-time
    Data engineer Spark Java Scala – JVM based language – Scala preferred Container exp – Kubernetes – plus skills Do not use python – do not use much – do not prefer python Written in Scala Some pipel...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    NS Partners • Vancouver
    Full-time
    Interested in joining one of Canada's top performing asset managers? We are looking for a Data Engineer for an existing vacancy in our IT department, Connor, Clark & Lunn Financial Group (CC&LFG) i...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Platform Engineer - Go & Big Data

    Senior Data Platform Engineer - Go & Big Data

    Rivian and Volkswagen Group Technologies • Vancouver
    Full-time
    A leading electric vehicle company is looking for a Software Engineer in Vancouver to enhance their data processing framework. Applicants should have strong Go programming skills and over 5 years of...Show more
    Last updated: 22 days ago • Promoted
    Lead Big Data Engineer : Petabyte-Scale Systems

    Lead Big Data Engineer : Petabyte-Scale Systems

    Amazon Development Centre Canada ULC • Vancouver
    Full-time
    A leading global technology company in Vancouver is seeking an experienced Sr.Software Development Engineer in Big Data Technologies to design scalable solutions, mentor junior engineers, and contr...Show more
    Last updated: 30+ days ago • Promoted
    Data Cloud Platform Engineer (DBA)

    Data Cloud Platform Engineer (DBA)

    PAD landscape • Vancouver
    Full-time
    Join INTRALOT as a Data Cloud Platform Engineer (DBA) - AWS Infrastructure.INTRALOT shapes the future of gaming through innovation and technology. We’re looking for a Data Cloud Platform Engineer (D...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Volt Capital • Vancouver
    Full-time
    Founded in 2021, LayerZero’s vision is to create a community of cross-chain developers, building dApps that are no longer constrained by individual blockchain capabilities.With LayerZero's simple, ...Show more
    Last updated: 14 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Two Circles • Vancouver, BC, CA
    Full-time
    Quick Apply
    We are a Sports & Entertainment Marketing business.We grow audiences and revenues.We do that by knowing fans best.We work with clients to help them understand & influence what their fans ar...Show more
    Last updated: 18 hours ago • New!
    Analytics Engineer : Lead Data Warehouse & BI (Flexible)

    Analytics Engineer : Lead Data Warehouse & BI (Flexible)

    Stoko • Vancouver
    Full-time
    An innovative apparel company in Vancouver is seeking an Analytics Engineer to spearhead their data infrastructure.This role requires a Bachelor's in a relevant field, strong expertise in SQL and P...Show more
    Last updated: 4 days ago • Promoted
    Senior Data & Software Engineer for Disruptive Mining Tech

    Senior Data & Software Engineer for Disruptive Mining Tech

    Go REcruitment • Vancouver
    Full-time
    A progressive technology firm in Vancouver is seeking a Senior Software Engineer to contribute to revolutionary mining technology development. The ideal candidate will have a background in software ...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Arbitrum • Vancouver
    Full-time
    Founded in 2021, LayerZero’s vision is to create a community of cross-chain developers, building dApps that are no longer constrained by individual blockchain capabilities.With LayerZero's simple, ...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Electronic Arts (EA) • Vancouver
    Full-time
    Electronic Arts creates next-level entertainment experiences that inspire players and fans around the world.Here, everyone is part of the story. Part of a community that connects across the globe.A ...Show more
    Last updated: 5 days ago • Promoted
    AWS Data Cloud Platform Engineer (DBA) - Hybrid

    AWS Data Cloud Platform Engineer (DBA) - Hybrid

    INTRALOT • Vancouver
    Full-time
    A leading gaming solutions supplier is seeking a Data Cloud Platform Engineer (DBA) to manage and optimize AWS database environments. You will ensure high availability, security, and performance of ...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    19 Works • Vancouver
    Full-time
    We’re seeking a skilled Data Engineer with expertise in ETL, relational databases, and cloud infrastructure.As Canada’s leading real estate platform, we empower millions of Canadians to navigate th...Show more
    Last updated: 4 days ago • Promoted