Data Engineer
On behalf of our client, Procom Consultants Group is currently looking for an Intermediate Data Engineer.
Requested resources to provide developer expertise on coding of data transformation pipelines and systems integration tasks relating to enterprise data management applications that span across different business areas and platforms.
Data Engineer Job Details
• Creating mapping documentation of data elements from source to target and liaising with other Data Engineers, Data Architects and SMEs.
• Developing & testing Data Transformation pipelines by leveraging the latest Big Data tools and technologies
• Collaborate with upstream data teams, develop data validation and test plans, performing user acceptance testing, and provide feedback to development and sustainment teams
• Conducting analysis for moderate to complex data requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
• Act as a lead developer to implement code changes in various environments and platforms leveraging our DevOps & DataOps
• Work closely with the testing team to assist with issues raised in user acceptance testing (UAT) and Business Value Testing (BVT)
Deliverables:
Fully implement the new data format across all IM supported platforms including
Big Data (Hadoop), Enterprise Data Warehouse (EDW) and Operational Data Store
(ODS)
Data Engineer Mandatory Skills
Communication & Problem Solving Skills:
• Communicating & presenting solutions to internal developers
• Ability to apply critical thinking skills to develop efficient code, data transformation logic and solution design
• Experience and/or understanding of Agile Methodologies
Technical Skills:
• Advanced Database Skills & SQL
• Experience with or exposure to Big Data platforms, ideally exposure to Hadoop ecosystem (HDFS, Apache Hive, Apache Spark, SparkSQL)
• Extensive programming experience in either Java, C++ or preferably Scala, IntelliJ, Jenkins
• Working experience with Apache Spark Data Processing Framework, Parquet data format
• Good understanding of Relational (Oracle/DB2) and Hadoop Big Data platforms
• Experience working with Jira
Data Engineer Start Date
Oct 24, 2022
Data Engineer Assignment Duration
March 31 2023
Data Engineer Working Location
Fully remote but PST hours
Data Engineer • North Vancouver, British Columbia, Canada
Remarcable is purpose-built for trade contractors, helping them manage procurement, tools, and warehouse operations with unmatched visibility and control.As we scale across North America, data is a... Show more
Enhance your career as a Data Engineer with HIVERY, focusing on advanced AI tools in a remote setting.Your expertise in Python or Go will drive improvements in our retail solutions.HIVERY, a startu... Show more
The Battle of Giants exists to answer a simple but important question:.Will a company’s strategy lead to growth?.Why? We do this to help investors and corporate execs assess a company’s growth pote... Show more
The Data Engineering team’s mission is to ensure high-quality data to enable data-informed decision-making across Asana.You will build data artifacts that are leveraged by Product and Business Data... Show more
Transform data into insights as an Advanced Data Engineer specializing in complex ETL pipelines.Embrace this remote opportunity to use your Python or Java and SQL skills effectively.This role invit... Show more
Seeking a Data Engineer to design, build, and support a self-serve data platform for analytics, AI, and business operations.Responsibilities include developing automated data pipelines, creating go... Show more
Become a Lead Data Engineer at Electronic Arts, where you will architect and manage end-to-end pipelines that enhance business decision-making and data quality.Reporting to the Senior Data Science ... Show more
As Sensor Tower continues to grow as a global company, we are looking for a Senior Data Engineer to build amazing products together.We have a wonderful team of more than a hundred engineers globall... Show more
A global commerce company in Canada is seeking a Data Engineer to lead efforts in building and optimizing the User Platform and Recommendation Engine.The role involves ensuring data accuracy and pe... Show more
Have you ever wondered how Amazon shipped your order so fast? Wondered where it came from or how much it cost us? To help describe some of our challenges, we created a short video about Supply Chai... Show more
Be part of Alberta's digital transformation as a Data Engineer.Contribute to innovative projects by creating data pipelines and deriving insights that meet the needs of citizens.As a core member of... Show more
Get AI-powered advice on this job and more exclusive features.About US: We are a company that provides innovative, transformative IT services and solutions.We are passionate about helping our clien... Show more
Data Engineer – Databricks (Mining Operations).We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South Amer... Show more
DarkVision is seeking a Data Engineer to join our Imaging & AI team.You will ensure the accuracy and reliability of our reporting pipelines by owning pipeline validation, data transformation logic ... Show more
A leading data solutions provider in Vancouver is seeking a skilled Data Engineer to design and implement data pipelines, ensuring efficient data flow for decision-making processes.The ideal candid... Show more
Your responsibilities include:.Providing technical expertise and assistance with the Extraction, Loading and Transformation of massive, unstructured datasets;.Working with data collection tools for... Show more
We are a Sports & Entertainment Marketing business.We grow audiences and revenues.We do that by knowing fans best.We work with clients to help them understand & influence what their fans are doing ... Show more
Central 1 cooperatively empowers credit unions and other financial institutions to deliver banking choice to Canadians.Central 1 provides critical services at scale to enable a thriving credit unio... Show more
Seeking a Staff Data Engineer to lead and mentor a team, design and maintain data pipelines, and ensure data reliability and governance to accelerate business growth. Show more
Become a Senior Data Engineer at Goodway Group and shape the future of data solutions.Collaborate in a remote-first environment while empowering analytics and driving business outcomes.Goodway Grou... Show more
