Data Engineer - Python
Reference Code : 048471 Responsibilities :
- Use of Databricks for transformation and loading of the data in the different layers
- Use of Spark / Python for the development of the libraries
- Use of Azure DevOps pipelines to automate the CI / CD
- Participate in the development of the dataset and incorporate new sources from the data lake
- Develop best practices on the data quality validationRequirements :
- 3 years in the development in spark / python
- 3 years on databricks
- 2 years on Azure DevOps
- Experience with Powershell
- Experience on azure data lake
- Experience on data factory
- Strong interpersonal, teamwork, coordination and consensus building skills
- Strong communication, documentation, storytelling, creativity, and presentation skills
- Strong organizational skills, the ability to perform under pressure and to manage multiple priorities with competing demands
- Bilingual (French & English) with excellent verbal and written communication skills.
Python Data Engineer, Sovereign
As a Data Engineer on Sovereign, leverage your skills to create impactful data solutions in a fast-moving and flexible environment. You'll drive critical projects within our team by maintaining extensive historical data repositories from diverse sources, ensuring data quality and developing versatil...
Data Engineer with Python DataBricks and Snowflake
Data Engineerwith Python DataBricks and Snowflake. Handson development experience with Snowflake featuressuch as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel;Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; andstored procedures. Developing EL pipelines in and out of data war...
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -19021
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. You will be ...
Python Data Engineer, Sovereign
As a Data Engineer on Sovereign, leverage your skills to create impactful data solutions in a fast-moving and flexible environment. You'll drive critical projects within our team by maintaining extensive historical data repositories from diverse sources, ensuring data quality and developing versatil...
Jr Data Engineer with Python, Sql and Tableau experience to support data driven projects for our large telco client -19022
Jr Data Engineer with Python, Sql and Tableau experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. You will ...
Lead Software Engineer
Company Background - Lead Backend Engineer (Go, Python, SQL, AWS). They’re looking for their first Lead Backend Engineer to help them build their latest AI offering. As the Lead Backend Engineer you will:. ...
Software Firmware Design Engineer
The SDS – Software/Firmware will receive coaching and guidance from the SDC Manager and experienced members of the Advanced Engineering Group’s management team to help acclimate him to the nature of our business, but he will be expected to use his engineering design and management experience to effe...
Senior Data Scientist- (Full-Time)
Discovering data sources, getting data access, and cleaning data. The Senior Data Scientist will have the opportunity define and lead technical activities in the creation of models, building of advanced analytics, and leveraging machine learning. Mentoring other data scientists to level up capabilit...
Senior Software Engineer
Agilus' client is the leading independent clearing broker and custodian in the Canadian market.They provide trade execution, clearing, custody and back-office support services to Canadian-based brokerage firms and the Canadian brokerage arms of U.Developer authors the high-level design of applicatio...
Software Engineer in Test
Work closely with the assigned scrum team (Product Owner, Engineering Owner, TPM, DevOps) to build reliable and scalable test suites/matrix. Demonstrates opinionated view based on experience in questioning/pushing back on requirements, UX design and engineering implementation. ...