Job Description
Senior Data Engineer - DataBricks-
Description
JOB LOCATION :
Vancouver, Calgary and Edmonton
KEY RESPONSIBILITIES :
- Architect, design and implement ETL (Extract, Transform, Load) processes to ingest data from various sources into Unity Catalog experience / knowledge is a strong asset
- Use notebooks to write code in PySpark, SparkR, or Spark SQL for data ingestion, preparation, and transformation
- Develop and manage frameworks for data ingestion and workflow orchestration using Data Factory or Dataflows
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
- Document data engineering processes, architecture, and configurations using Agile methodology to support use cases, ensuring standardization and reusability of work products.
REQUIRED SKILLS
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 5+ years of experience in data engineering, with a focus on Microsoft Azure and related technologies.
- Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.
- Proficiency in SQL, Python, R, and other relevant programming languages.
- Unity Catalog Experience is desired.
- Fabric Analytics Engineer Associate or Azure Data Engineer Associate certifications are a plus.
Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer :
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs
- Financial well-being programs and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized back-up child / elder care and tutoring
- Mentoring, coaching and learning programs
- Employee Resource Groups
- Disaster Relief
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society.
It is a responsible and diverse group of , team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs.
It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
The Group reported global revenues of €22.5 billion.
Get The Future You Want Disclaimer
Senior Consultant, Data Privacy Engineer
Data literacy: finding and managing data, cleansing data, manipulating data. Database, Compliance, Test Engineer, Testing, Software Engineer, Technology, Legal, Engineering. As a Data Privacy Engineer, you will be at the forefront of Deloitte's mission to ensure data privacy and protection. Responsi...
Senior Data Engineer, Services
As part of the theScore Data Engineering team, you will be working with a team of smart, friendly, and dedicated Data Engineers, Analysts, and Data Scientists determined to develop high-quality and sustainable data-driven solutions to improve profitability, growth and the user experience. The ideal ...
Senior/Staff Data Engineer
We're looking to add Senior and Staff Data Engineers to our data science team! This team works on solving complex problems for StackAdapt's digital advertising platform. You'll be working directly with our data scientists, data engineers, Engineering team, and CTO on building pipelines and ad optimi...
Senior Machine Learning & Data Engineer
Senior Machine Learning and Data Engineer is responsible for developing application for large-scale data processing and analysis. E2E technical competency including conducting data analysis, data preprocessing, and feature engineering to prepare datasets for model training. Work alongside data scien...
Senior Data Engineer
Senior Data Engineer sought to design, implement, and optimize data pipelines and data warehouses, leveraging cloud technologies and data engineering tools. The Senior Data Engineer will play a pivotal role in driving data-driven decision-making at TELUS International. The ideal candidate will be a ...
Senior Data Engineer
Do you have experience building data pipelines and transforming raw data into relevant insights? Are you an expert in Snowflake development, with an understanding of cloud platforms and big data tools? If so, we want to hear from you!. We are looking for a Senior Data Engineer to join our growing te...
Senior Data Engineer
As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on cloud infrastructure. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them ...
Senior Software Engineer - Data
Contribute to the architecture design while taking into account current data problems and following engineering best practices. Build an efficient, scalable data processing service using Java, Spark or PySpark. Experience in parsing technology like ANTLR and using Data Lakehouse formats like Apache ...
Senior Software Engineer, Data
Collaborate with product managers, data analysts, and machine learning engineers to develop pipelines and ETL tasks in order to facilitate the extraction of insights. You have developed maintainable data pipelines with them. You are experienced in creating automated testing, applying design patterns...
Senior Data Engineer
Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis. You are accountable for architecting, implementing and managing data models and data pipelines, developing, maintaining an...