Talent.com
Data Engineer
Data EngineerCB Canada • North Vancouver, British Columbia, Canada
Data Engineer

Data Engineer

CB Canada • North Vancouver, British Columbia, Canada
30+ days ago
Job type
  • Full-time
Job description

Data Engineer

On behalf of our client, Procom Consultants Group is currently looking for an Intermediate Data Engineer.

Requested resources to provide developer expertise on coding of data transformation pipelines and systems integration tasks relating to enterprise data management applications that span across different business areas and platforms.

Data Engineer Job Details

  • Creating mapping documentation of data elements from source to target and liaising with other Data Engineers, Data Architects and SMEs.
  • Developing & testing Data Transformation pipelines by leveraging the latest Big Data tools and technologies
  • Collaborate with upstream data teams, develop data validation and test plans, performing user acceptance testing, and provide feedback to development and sustainment teams
  • Conducting analysis for moderate to complex data requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
  • Act as a lead developer to implement code changes in various environments and platforms leveraging our DevOps & DataOps
  • Work closely with the testing team to assist with issues raised in user acceptance testing (UAT) and Business Value Testing (BVT)

Deliverables :

Fully implement the new data format across all IM supported platforms including

Big Data (Hadoop), Enterprise Data Warehouse (EDW) and Operational Data Store

(ODS)

Data Engineer Mandatory Skills

Communication & Problem Solving Skills :

  • Communicating & presenting solutions to internal developers
  • Ability to apply critical thinking skills to develop efficient code, data transformation logic and solution design
  • Experience and / or understanding of Agile Methodologies
  • Technical Skills :

  • Advanced Database Skills & SQL
  • Experience with or exposure to Big Data platforms, ideally exposure to Hadoop ecosystem (HDFS, Apache Hive, Apache Spark, SparkSQL)
  • Extensive programming experience in either Java, C++ or preferably Scala, IntelliJ, Jenkins
  • Working experience with Apache Spark Data Processing Framework, Parquet data format
  • Good understanding of Relational (Oracle / DB2) and Hadoop Big Data platforms
  • Experience working with Jira
  • Data Engineer Start Date

    Oct 24, 2022

    Data Engineer Assignment Duration

    March 31 2023

    Data Engineer  Working Location

    Fully remote but PST hours

    Create a job alert for this search

    Data Engineer • North Vancouver, British Columbia, Canada

    Similar jobs
    Data Engineer (MS Fabric / Databricks) - Senior Consultant

    Data Engineer (MS Fabric / Databricks) - Senior Consultant

    Deloitte • Vancouver, British Columbia, Canada
    Permanent
    Calgary, AB; Brossard, QC; Burlington, ON; Edmonton, AB; Fredericton, NB; Halifax, NS; Kitchener, ON; Laval, QC; Moncton, NB. Montreal, QC; Ottawa, ON; Quebec City, QC; Regina, SK; Saint John, NB; ...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Ace1Media • Vancouver
    Full-time
    Ace1 Media is a dynamic and innovative media company specializing in creating high-quality content and data-driven solutions to support business growth. We leverage cutting-edge technology to stream...Show more
    Last updated: 12 days ago • Promoted
    Data Engineer

    Data Engineer

    Semios • Vancouver
    Full-time
    Founded in 2010, Semios Group is a leading agricultural technology company helping growers, agronomists, and ag retailers manage over 100 million acres across five countries.Semios pioneered variab...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer — Fabric & Databricks (Hybrid)

    Senior Data Engineer — Fabric & Databricks (Hybrid)

    Deloitte Canada • Vancouver
    Full-time
    A leading professional services firm is seeking a Senior Consultant for a Data Engineer role focused on Microsoft Fabric and Databricks. The position involves designing and implementing modern data ...Show more
    Last updated: 12 days ago • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Hays • richmond, bc, ca
    Full-time
    The ideal candidate will help design, implement, and maintain secure, scalable, and compliant AWS environments while driving automation across the organization. Strong hands-on experience with.IAM p...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Tradable Bits • Vancouver
    Full-time
    Get AI-powered advice on this job and more exclusive features.Tradable Bits is an award-winning tech company that helps sports, music and entertainment brands build better fan experiences.Based in ...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Net2Source (N2S) • surrey, bc, ca
    Full-time +1
    Lead Data Engineer (Planning & Forecasting | Kafka | Snowflake | AWS | GitLab CI / CD).Must be authorized to work in Canada. Non Negotiable Tech : Airflow,.This role will work closely with Product, UX...Show more
    Last updated: 12 days ago • Promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    TekRek • richmond, bc, ca
    Full-time
    TekRek has partnered with a fast growing firm specializing in AI enablement and data optimization.Our client works with some of the top tier technology firms in Silcom Valley.With rapid growth and ...Show more
    Last updated: 24 days ago • Promoted
    Data Engineer

    Data Engineer

    Connor, Clark & Lunn Financial Group (CC&L) • Vancouver
    Full-time
    Interested in joining one of Canada's top performing asset managers? We are looking for a Data Engineer for an existing vacancy in our IT department. Connor, Clark & Lunn Financial Group (CC&LFG) is...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Swim Recruiting • Vancouver, British Columbia, Canada
    Full-time +1
    Full-time permanent opportunity with a rapidly growing lifestyle brand at the intersection of retail, e-commerce, and technology. Permanent Lead Data Engineer role.Collaborative and data-driven envi...Show more
    Last updated: 18 days ago • Promoted
    Data Engineer

    Data Engineer

    Volt Capital • Vancouver
    Full-time
    Founded in 2021, LayerZero’s vision is to create a community of cross-chain developers, building dApps that are no longer constrained by individual blockchain capabilities.With LayerZero's simple, ...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    LayerZero Labs • Vancouver
    Full-time
    Founded in 2021, LayerZero’s vision is to create a community of cross-chain developers, building dApps that are no longer constrained by individual blockchain capabilities.With LayerZero's simple, ...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Capgemini Engineering • Vancouver, Bc
    Full-time
    Job Title : Senior Data Engineer – Big Data Solutions.Join Capgemini as a Senior Data Engineer and play a pivotal role in transforming how businesses leverage data. You’ll design and build scalable d...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer

    Data Engineer

    BC College of Nurses and Midwives • Vancouver
    Full-time
    Temporary, Full-Time (1-year term, potential for extension).The British Columbia College of Nurses & Midwives (BCCNM) is the college empowered under the Health Professions Act to regulate the pract...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    Arbitrum • Vancouver
    Full-time
    Founded in 2021, LayerZero’s vision is to create a community of cross-chain developers, building dApps that are no longer constrained by individual blockchain capabilities.With LayerZero's simple, ...Show more
    Last updated: 2 days ago • Promoted
    Data Analytics Engineer

    Data Analytics Engineer

    Ignition • Vancouver
    Full-time
    Founded in 2013, Ignition is the leading revenue generation platform for accounting and professional services businesses to spark greater efficiency and profitability. Ignition automates and optimiz...Show more
    Last updated: 12 days ago • Promoted
    Data Engineer : ELT Pipelines for Civic Impact

    Data Engineer : ELT Pipelines for Civic Impact

    Victrays • Vancouver
    Full-time
    A data-driven solutions company in Vancouver is looking for a Software Engineer to join its data team.You will be instrumental in developing ELT pipelines and analyzing unique datasets to drive com...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Two Circles • Vancouver
    Full-time +1
    We grow audiences and revenues by helping our clients know fans best.We analyze fan behavior across spending, event attendance, channel engagement, and content consumption to empower leading sports...Show more
    Last updated: 12 days ago • Promoted