Talent.com
Data Engineer
Data EngineerCB Canada • North Vancouver, British Columbia, Canada
Data Engineer

Data Engineer

CB Canada • North Vancouver, British Columbia, Canada
30+ days ago
Job type
  • Full-time
Job description

Data Engineer

On behalf of our client, Procom Consultants Group is currently looking for an Intermediate Data Engineer.

Requested resources to provide developer expertise on coding of data transformation pipelines and systems integration tasks relating to enterprise data management applications that span across different business areas and platforms.

Data Engineer Job Details

  • Creating mapping documentation of data elements from source to target and liaising with other Data Engineers, Data Architects and SMEs.
  • Developing & testing Data Transformation pipelines by leveraging the latest Big Data tools and technologies
  • Collaborate with upstream data teams, develop data validation and test plans, performing user acceptance testing, and provide feedback to development and sustainment teams
  • Conducting analysis for moderate to complex data requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
  • Act as a lead developer to implement code changes in various environments and platforms leveraging our DevOps & DataOps
  • Work closely with the testing team to assist with issues raised in user acceptance testing (UAT) and Business Value Testing (BVT)

Deliverables :

Fully implement the new data format across all IM supported platforms including

Big Data (Hadoop), Enterprise Data Warehouse (EDW) and Operational Data Store

(ODS)

Data Engineer Mandatory Skills

Communication & Problem Solving Skills :

  • Communicating & presenting solutions to internal developers
  • Ability to apply critical thinking skills to develop efficient code, data transformation logic and solution design
  • Experience and / or understanding of Agile Methodologies
  • Technical Skills :

  • Advanced Database Skills & SQL
  • Experience with or exposure to Big Data platforms, ideally exposure to Hadoop ecosystem (HDFS, Apache Hive, Apache Spark, SparkSQL)
  • Extensive programming experience in either Java, C++ or preferably Scala, IntelliJ, Jenkins
  • Working experience with Apache Spark Data Processing Framework, Parquet data format
  • Good understanding of Relational (Oracle / DB2) and Hadoop Big Data platforms
  • Experience working with Jira
  • Data Engineer Start Date

    Oct 24, 2022

    Data Engineer Assignment Duration

    March 31 2023

    Data Engineer  Working Location

    Fully remote but PST hours

    Create a job alert for this search

    Data Engineer • North Vancouver, British Columbia, Canada

    Similar jobs
    Data Engineer II

    Data Engineer II

    Spring Financial Inc. • Vancouver, BC, Canada
    Full-time +1
    Salary : $100,000-$120,000 yearly salary + benefits (See below for more details).Spring Financial is revolutionizing financial access for Canadians, providing smart credit-building, mortgage, and le...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data & AI Engineer

    Cloud Data & AI Engineer

    OSI Digital • Vancouver, BC, Canada
    Full-time
    At OSI Digital Inc, we accelerate our client’s digital transformation journey by delivering modern data solutions, enabling them to unlock the full potential of their data with scalable cloud...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    TradableBits Media Inc. • Vancouver, BC, Canada
    Full-time
    Salary : $90,000 - $130,000 / annually.Tradable Bits is an award-winning tech company that helps sports, music and entertainment brands build better fan experiences. Based in Vancouver, Canada, we work...Show more
    Last updated: 30+ days ago • Promoted
    Data Scientist / Machine Learning Engineer (Recommendation Systems)

    Data Scientist / Machine Learning Engineer (Recommendation Systems)

    Beatdapp • Vancouver, BC, Canada
    Full-time
    Beatdapp is a venture-backed startup delivering the most advanced streaming integrity and recommendation technology in the world1. While our roots are in fighting the multi-billion dollar problem of...Show more
    Last updated: 7 days ago • Promoted
    Guidewire Engineer

    Guidewire Engineer

    BuzzClan • richmond, bc, ca
    Full-time
    Guidewire PolicyCenter Configuration – Senior.Year Contract (Extension Possible).Guidewire PolicyCenter Configuration Developer. GOSU, Java, and web development.The ideal candidate will be hands-on ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Targeted Talent • Richmond, BC, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is completely remote! Our client is a global enterprise company with a product that you've likely used.Within this role, you&...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Engineer - Copperleaf

    Lead AI Engineer - Copperleaf

    IFS • Vancouver, BC, Canada
    Full-time
    IFS is a billion-dollar revenue company with 7000+ employees on all continents.We deliver award winning enterprise software solutions through the use of embedded digital innovation and a single clo...Show more
    Last updated: 30+ days ago • Promoted
    R Engineer

    R Engineer

    SuperAnnotate • Richmond, British Columbia, CA
    Remote
    Full-time
    As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...Show more
    Last updated: 20 hours ago • New!
    Lead Data Engineer

    Lead Data Engineer

    Two Circles • Vancouver, BC, Canada
    Full-time
    We are a Sports & Entertainment Marketing business.We grow audiences and revenues.We do that by knowing fans best.We work with clients to help them understand & influence what their fans ar...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Spring Financial Inc. • Vancouver, BC, Canada
    Full-time +1
    Salary : $120,000-$140,000 yearly salary + benefits (See below for more details).Spring Financial is revolutionizing financial access for Canadians, providing smart credit-building, mortgage, and le...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Mastech Digital • richmond, bc, ca
    Full-time
    This job is for someone who makes sure data is flowing smoothly, accurately, and without problems across the company.Watch and monitor data systems. Investigate and fix data problems.Work closely wi...Show more
    Last updated: 20 days ago • Promoted
    Data Cloud Platform Engineer (DBA)

    Data Cloud Platform Engineer (DBA)

    Bally's Intralot • Vancouver, BC, CA
    Full-time
    Join INTRALOT as a Data Cloud Platform Engineer (DBA) - AWS Infrastructure.At INTRALOT, we shape the future of gaming through innovation and technology. Our global presence, diverse culture, and dyn...Show more
    Last updated: 6 hours ago • New!
    Data Architect

    Data Architect

    Invinity Energy Systems • Vancouver
    Full-time
    Energy storage is the most exciting area in energy today.Massive amounts of energy storage are required if renewable energy is to take its rightful place on the electric grid.Invinity provides an a...Show more
    Last updated: 4 days ago • Promoted
    Financial Data Analytics Engineer

    Financial Data Analytics Engineer

    FISPAN • Vancouver, BC, Canada
    Permanent +1
    FISPAN) is an Enterprise SaaS FinTech company that allows banks to deploy embedded financial products and services to create a seamless banking connection for their corporate clients.Our product ai...Show more
    Last updated: 3 days ago • Promoted
    Cloud Data Architect : Lead Next-Gen Data Platforms

    Cloud Data Architect : Lead Next-Gen Data Platforms

    Slalom • Vancouver
    Full-time
    A leading business consulting firm is seeking a Data Architect in Vancouver.This role involves designing and delivering cloud-based data solutions, understanding client needs, and leading the devel...Show more
    Last updated: 14 days ago • Promoted
    Senior Frontend Engineer : Data Visualization & Dashboards

    Senior Frontend Engineer : Data Visualization & Dashboards

    Databricks • Vancouver
    Full-time
    A leading data and AI company in Vancouver is seeking a Senior Software Engineer focusing on Data Visualization.In this role, you will design and build intuitive interfaces that help users visualiz...Show more
    Last updated: 14 days ago • Promoted
    Data Architect, Intermediate — Big Data & Analytics

    Data Architect, Intermediate — Big Data & Analytics

    ICBC (Insurance Corporation of British Columbia) • North Vancouver
    Full-time
    A leading insurance provider in Canada is seeking a Data Architect - Intermediate to join their Data Management team.The role focuses on developing data and analytics solutions, ensuring business p...Show more
    Last updated: 12 days ago • Promoted
    Python Engineer

    Python Engineer

    Swim Recruiting • Vancouver, British Columbia, Canada
    Temporary
    Python Services Engineer role with a global organization.Contract Python Services Engineer role.Large scale team developing high profile applications. Primarily on site work with 4 days in office.As...Show more
    Last updated: 18 days ago • Promoted