Talent.com
Data Engineer
Data EngineerThoughtsWin • Surrey, Metro Vancouver Regional District, CA
No longer accepting applications
Data Engineer

Data Engineer

ThoughtsWin • Surrey, Metro Vancouver Regional District, CA
30+ days ago
Job type
  • Full-time
Job description

Senior Data Engineer

Looking for Senior Data Engineers who are experienced, self‑driven, analytical, and strategic. In this role you will work with clients across large and complex data lake / warehouse environments, bringing disparate datasets together to answer business questions. Your deep expertise in creating and managing datasets, and proven ability to translate data into meaningful insights through collaboration with product managers, data engineers, business intelligence developers, operations managers, and client leaders will be integral to strategic decision‑making and complex problem solving.

Responsibilities

  • Interface with project managers, business customers, data architects and data modelers to understand requirements and implement solutions.
  • Design, develop, and operate highly scalable, high‑performance, low‑cost, and accurate data pipelines in distributed data processing platforms providing ad hoc access to large datasets and computing power.
  • Explore and learn the latest big data technologies; evaluate and make decisions around the use of new or existing software products to design data architectures.
  • Recognize and adopt best practices in data processing, reporting, and analysis : data integrity, test design, analysis, validation, and documentation.

Qualifications

  • Bachelor’s degree in Computer Science or related technical field, or equivalent work experience.
  • 5+ years of work experience with ETL, Data Modeling, and Data Architecture.
  • 5+ years of experience with SQL and large data sets, data modeling, ETL development, and data warehousing, or similar skills.
  • 2+ years experience with the AWS or MS Azure technology stacks. AWS should include Redshift, RDS, S3, EMR or similar solutions built around Hive / Spark, etc. MS Azure should include ADF, Azure Blob storage, Azure Synapse, etc.
  • Excellent in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
  • Experience operating very large data warehouses or data lakes.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Demonstrate efficiency in handling data – tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Knowledge of distributed systems and data architecture – design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high‑level data structures.
  • Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, and testing.
  • Seniority Level

    Mid‑Senior level

    Employment Type

    Full‑time

    Job Function

    Information Technology, Engineering, and Other

    Industries

    IT System Data Services and IT System Operations & Maintenance

    #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Surrey, Metro Vancouver Regional District, CA

    Similar jobs
    Data Engineer II

    Data Engineer II

    Spring Financial Inc. • Vancouver, BC, Canada
    Full-time +1
    Salary : $100,000-$120,000 yearly salary + benefits (See below for more details).Spring Financial is revolutionizing financial access for Canadians, providing smart credit-building, mortgage, and le...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer 1 Bengaluru, India

    Data Engineer 1 Bengaluru, India

    Zynga • Vancouver
    Full-time
    At Zynga, we bring people together through the power of play.As a global leader in interactive entertainment and a proud label of Take‑Two Interactive, our games have been downloaded over 6 billion...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    TradableBits Media Inc. • Vancouver, BC, Canada
    Full-time
    Salary : $90,000 - $130,000 / annually.Tradable Bits is an award-winning tech company that helps sports, music and entertainment brands build better fan experiences. Based in Vancouver, Canada, we work...Show more
    Last updated: 30+ days ago • Promoted
    Data Scientist / Machine Learning Engineer (Recommendation Systems)

    Data Scientist / Machine Learning Engineer (Recommendation Systems)

    Beatdapp • Vancouver, BC, Canada
    Full-time
    Beatdapp is a venture-backed startup delivering the most advanced streaming integrity and recommendation technology in the world1. While our roots are in fighting the multi-billion dollar problem of...Show more
    Last updated: 22 days ago • Promoted
    Lead AI Engineer - Copperleaf

    Lead AI Engineer - Copperleaf

    IFS • Vancouver, BC, Canada
    Full-time
    IFS is a billion-dollar revenue company with 7000+ employees on all continents.We deliver award winning enterprise software solutions through the use of embedded digital innovation and a single clo...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tradable Bits • Vancouver
    Full-time
    Get AI-powered advice on this job and more exclusive features.Tradable Bits is an award-winning tech company that helps sports, music and entertainment brands build better fan experiences.Based in ...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    INTELLISWIFT INC • Burnaby
    Full-time
    Data engineer Spark Java Scala – JVM based language – Scala preferred Container exp – Kubernetes – plus skills Do not use python – do not use much – do not prefer python Written in Scala Some pipel...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Two Circles Ltd • Vancouver
    Full-time
    Choose an international site to browse relevant content.We are a Sports & Entertainment Marketing business.We grow audiences and revenues. We do that by knowing fans best.We work with clients to hel...Show more
    Last updated: 9 days ago • Promoted
    AI and Data Engineer

    AI and Data Engineer

    Monark • Surrey, BC, Canada
    Full-time
    We are seeking a motivated AI & Data Engineer with 23 years of experience to join our innovative team.This role sits at the intersection of data engineering, cloud analytics, and applied AI, wh...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Capgemini Engineering • Vancouver, Bc
    Full-time
    Job Title : Senior Data Engineer – Big Data Solutions.Join Capgemini as a Senior Data Engineer and play a pivotal role in transforming how businesses leverage data. You’ll design and build scalable d...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Uplight • Vancouver
    Full-time
    Join or sign in to find your next job.Continue with Google Continue with Google.We make software that manages energy resources in homes and businesses—including things like smart thermostats, elect...Show more
    Last updated: 9 days ago • Promoted
    Financial Data Analytics Engineer

    Financial Data Analytics Engineer

    FISPAN • Vancouver, BC, Canada
    Permanent +1
    FISPAN) is an Enterprise SaaS FinTech company that allows banks to deploy embedded financial products and services to create a seamless banking connection for their corporate clients.Our product ai...Show more
    Last updated: 19 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Industrio • Vancouver
    Full-time +1
    We'reseeking a Senior Data Engineer with deep expertisein data modeling, governance, and modern data platforms.The ideal candidate will architect robust data pipelines and have a proven track recor...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RB Global Inc. • Burnaby
    Full-time
    The Senior Data Engineer on the Customer Data team will be a hands-on technical contributor with deep expertise in data engineering and application development. You will lead the design, development...Show more
    Last updated: 9 days ago • Promoted
    Python Engineer

    Python Engineer

    Swim Recruiting • Vancouver, British Columbia, Canada
    Temporary
    Python Services Engineer role with a global organization.Contract Python Services Engineer role.Large scale team developing high profile applications. Primarily on site work with 4 days in office.As...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Targeted Talent • Delta, BC, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is completely remote! Our client is a global enterprise company with a product that you've likely used.Within this role, you&...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    GPL Technologies • Vancouver, BC, Canada
    Full-time
    Cloud Engineer - Media & Entertainmen Workflows .At GPL Technologies, our mission is to provide powerful, reliable, and innovative technology services and leadership to creative companies ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Two Circles • Vancouver
    Full-time
    We grow audiences and revenues by helping our clients know fans best.We analyze fan behavior across spending, event attendance, channel engagement, and content consumption to empower leading sports...Show more
    Last updated: 9 days ago • Promoted