Data Engineer - Python
Reference Code : 048471 Responsibilities :
- Use of Databricks for transformation and loading of the data in the different layers
- Use of Spark / Python for the development of the libraries
- Use of Azure DevOps pipelines to automate the CI / CD
- Participate in the development of the dataset and incorporate new sources from the data lake
- Develop best practices on the data quality validationRequirements :
- 3 years in the development in spark / python
- 3 years on databricks
- 2 years on Azure DevOps
- Experience with Powershell
- Experience on azure data lake
- Experience on data factory
- Strong interpersonal, teamwork, coordination and consensus building skills
- Strong communication, documentation, storytelling, creativity, and presentation skills
- Strong organizational skills, the ability to perform under pressure and to manage multiple priorities with competing demands
- Bilingual (French & English) with excellent verbal and written communication skills.
Jr Data Engineer with Python, Sql and Tableau experience to support data driven projects for our large telco client -19022
Jr Data Engineer with Python, Sql and Tableau experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. You will ...
Data Engineer with Python DataBricks and Snowflake
Data Engineerwith Python DataBricks and Snowflake. Handson development experience with Snowflake featuressuch as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel;Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; andstored procedures. Developing EL pipelines in and out of data war...
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -19021
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. You will be ...
Python Data Engineer, Sovereign
As a Data Engineer on Sovereign, leverage your skills to create impactful data solutions in a fast-moving and flexible environment. You'll drive critical projects within our team by maintaining extensive historical data repositories from diverse sources, ensuring data quality and developing versatil...
Python Data Engineer, Sovereign
As a Data Engineer on Sovereign, leverage your skills to create impactful data solutions in a fast-moving and flexible environment. You'll drive critical projects within our team by maintaining extensive historical data repositories from diverse sources, ensuring data quality and developing versatil...
Senior Product Software Engineer - 3DX Technical Architect
Engineering Change Control process, document control and distribution, desktop hardware-software knowle. ...
Staff Cloud DevOps/Site Reliability Engineer
DevOps, Infrastructure, Operations, or Site Reliability Engineer (or as a software engineer with relevant experience). We are looking for a Staff Cloud DevOps/Site Reliability Engineer to join our team. Our Technical Operations team manages the infrastructure, DevOps, and Site Reliability of our pla...
Data Engineer
My client are seeking a talented Data Engineer to join their innovative team. Design, build, and scale data pipelines for large-scale analysis. Support the development of our data platform architecture. Collaborate with a team of top-tier scientists and engineers. ...
DevOps Engineer
Design and develop deployment automation and validation tools across the entire software stack. ...
Senior Machine Learning Engineer
Build and maintain a scalable machine learning infrastructure for model training and deployment. Build and debug state of the art machine learning computer vision models for survival prediction, segmentation, and classification problems. Trained on over 222 million images with associated clinical in...