Tasks / Responsibilities
The Lead Data Engineer will be responsible for improving the data lake and the processes put in place for the different product lines of a multinational.
MORE PRECISELY
- Understand business priorities and design the optimal data solutions
- Lead the design of data platform architecture and create automated pipelines
- Supervise 3 Data Engineer who each manages different product lines
- Work in collaboration with Data Architects, BI / ETL developers, and Data Scientists
- Work with GCP Services (Big Query, Dataflow, Cloud Functions, Cloud Run, etc.) and in an environment on Apache Spark, PySpark, Python and SQL
PROFILE
5+ years of experience as a Data EngineerProfessional experience with Google Cloud Platform (GCP), strong assetKnowledge in a Python and Apache Spark environmentExperience in a manufacturing environment, strong assetBAC in computer science or equivalentEnglish required