Data Engineer-GCP
Atos
Toronto, Ontario, Canada
$102.2K-$142K a year (estimated)
Full-time
Job Role : GCP Data Engineer
Location; Mountain View, CA -Onsite
Requirements / Experience / Advanced Knowledge required :
- Over 5 years of experience in the data engineering field.
- Deep understanding of and passion for algorithms, data structures, and complex data processing.
- Advanced knowledge in Modern Data Warehouse environments.
- Expertise in SQL programming languages and additional scripting languages such as Python or Java.
- Proficiency in monitoring, optimizing, and troubleshooting data solutions.
- Experience in designing and implementing using BigQuery, Cloud Storage, and Cloud Bigtable.
- Experience in designing and implementing solutions using Dataflow, Dataproc, and Pub / Sub.
- Familiarity with CI / CD practices, automation, and DevOps integration for data pipelines.
Responsibilities :
- Design, model, develop, and maintain data sets for analytics, reporting, and exploratory analysis.
- Adapt existing algorithms for parallelized and / or distributed processing.
- Develop and maintain enterprise-level business intelligence models.
- Architect robust and scalable data pipelines solutions.
- Design / implement distributed data pipelines with a focus on automation and best CI / CD practices.
Nice to Have
- Proficiency in Python programming language for data engineering tasks.
- Experience with GCP data services and administration.
- GCP Professional Data Engineer Certification or equivalent experience.
- Familiarity with Kubernetes and other orchestration tools for managing containerized applications.
- Experience working in one of these sectors : Cloud Services Providers, E-Commerce, Financial Services.
12 days ago