Data Engineer - Data Integration Strategy - Hybrid

Randstad Canada
Halifax, Nova Scotia, CA
Temporary
Quick Apply

seeking an experienced Data Engineer to play a role for a centralized data

integration platform and Business Intelligence (BI) Dashboard strategy within our port-wide ecosystem.

Leveraging the Microsoft Azure and Databricks platforms, this individual will play a pivotal role in

designing, building and optimizing our data integration platform.

Advantages

Responsibilities

Key Responsibilities :

Work closely with Director of IT, IT project Manager, data integration team, consultants,

business units, and external partners to ensure data is robust, scalable and aligned to needs.

  • Work with stakeholders to achieve consensus on reports and dashboard design requirements.
  • Collaborate with system analyst, systems integration analyst, systems developer, IT Data

Analyst, IT project manager and Director ITS to design, develop, test, implement and support

technical solutions in around data ingestion and transformation.

Collaborate with project stakeholders to understand requirements, prioritize tasks and work

with development team to meet project timelines.

  • Conduct rigorous unit testing and validation to ensure requirements performs as expected.
  • Strong programming knowledge in Python and SQL, experience using Source Control

Qualifications

Bachelor’s degree in computer science, Software Development or a related field.

  • Strong background in data engineering, with at least 2 years of experience in a similar role,
  • Proficient in Microsoft Azure services and Databricks, with a deep understanding of cloud

computing, data lakes, and analytics platforms.

Demonstrated experience in developing and implementing data integration and BI solutions,

with a portfolio of successful projects.

Excellent analytical and problem-solving skills, with the ability to translate complex business

requirements into technical solutions.

Exceptional communication and stakeholder management skills, capable of engaging with both

technical teams and business leadership.

Experience with Agile and Scrum methodologies, with a proven track record of working in

collaborative, cross-functional teams.

Certifications in Azure, Databricks, or related technologies are highly desirable.

Nice to have :

  • Advanced skills with Git
  • Experience working with Data
  • Experience with Spark and PySpark
  • Experience with Azure
  • Experience with Azure DevOps and Git

Summary

Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees.

In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary / gender non-conforming;

Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.

Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle.

We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.

ca to ensure their ability to fully participate in the interview process.

8 days ago
Related jobs
MongoDB
Canada

Our team has a big mission to build a data platform for MongoDB R&D to use to make data-informed decisions. Our team owns the cloud infrastructure for DevProd, and we’re expanding our focus to include a Data Platform. The mission of DevProd is to empower MongoDB developers to efficiently build a tra...

KPMG
Canada, Canada

The role of a Senior Data Integration Developer (Operation Team) is to deliver services and solutions for KPMG Canada internal clients through the Enterprise Analytics CoE using the suite of Microsoft Azure Data Services and data integrations. Develop and implement data integration solutions using A...

BMO
Canada, Canada

You'll consult with data scientists, the data and analytics teams, technology partners, business partners to create pipelines, governance and solutions that impact a variety of model ops, data and insight challenges across the North American Commercial Bank. Prepare modeling master data sets in coll...

StackAdapt
Canada

We're seeking a Staff Software Engineer to help lead our growing backend engineering team. Integrate data into StackAdapt’s Customer Data Platform (CDP). Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Architect scal...

Great Canadian Gaming Corp.
Canada, Canada

Experience with real-time data ingestion and processing using tools like Azure Stream Analytics, especially for pushing data into the data lake in near-real-time. Knowledge of using Azure Databricks or Synapse for data processing, transformation, and analytics within the data lake environment. Senio...

StackAdapt
Canada

Working with large data sets and various databases including Aerospike, Elasticsearch, Redis, ScyllaDB, Redshift, TiDB, MariaDB. Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Very strong problem solving skills in d...

Great Canadian Gaming Corp.
Canada, Canada

Software Data Engineer (#62198). Mindwire Systems is seeking the services of a Software Data Engineer for a contract position with one of our Valued Clients. Interrogating data for quality assurance before building advanced data models. Advanced experience on data extract, transform/load processes w...

ShoreWise Consulting
Canada, Canada

Integrate Guidewire with data platforms to enable seamless data exchange. Design and develop schemas and data models within the Snowflake platform. Write and optimize complex SQL queries for data extraction and transformation. Apache Nifi, Talend, dbt) to design and execute efficient data transforma...

StackAdapt
Canada

You'll be working directly with our data scientists, data engineers, Engineering team, and CTO on building pipelines and ad optimization models. We're looking to add Senior and Staff Data Engineers to our data science team! This team works on solving complex problems for StackAdapt's digital adverti...

Stripe
Canada
Remote

Data Transformation builds and operates the transformation abstractions and infrastructure that support frictionless data development across the board, sub-minute event data to enormous daily partitions - or even for-all-time snapshots. The Data Transformation and Movement team operates the critical...