Search jobs > Toronto, ON > Data engineer

Data & AI Engineering - Data Engineer

Capgemini
Toronto, ON, CA
$130K-$165K a year (estimated)
Full-time

Data & AI Engineering - Data Engineer-076290

Description

Job Location :

Canada (Hybrid) the closest Capgemini office.

Job Description :

As Sr Data Engineer, you will work on one of the world's largest social media platform which deals with a few petabytes of data coming to the system daily.

You will chip in as part of R&D self-organized team working in a complicated, innovative environment for our client.

Investigate, build, and implement the solutions for many technical challenges using groundbreaking technologies, including building / improving Data processing platform enabling work of software used by hundreds of millions of users.

Key Responsibilities :

  • Collaborate with multi-functional partners to collect data requirements.
  • Develop data pipelines using python to import data into snowflake.
  • Ensures that assigned area / areas are delivered within set deadlines and required quality objectives.
  • Provides estimations, agrees task duration with the manager and chips in to project plan of assigned area.
  • Analyzes scope of alternative solutions and makes decisions about area implementation based on their experience and technical expertise.
  • Reports about area readiness / quality, and raise red flags in crisis situations which are beyond their AOR.
  • Responsible for resolving crisis situations within their AOR.
  • Initiates and conducts code reviews, builds code standards, conventions, and guidelines.
  • Suggests technical and functional improvements to make valuable contributions to the product.
  • Constantly improves their professional level.

Required Skills :

  • University degree in Computer Related Sciences or similar
  • demonstrated ability as Data engineer in creating data pipelines for a cloud data warehouse.
  • Strong python and SQL skills
  • Experience building data pipelines in python Experience with extracting data from Rest APIs and ingesting it to a cloud data warehouse
  • Experience working with S3 buckets and writing DAGs on Airfloow
  • Rigor in high code quality, automated testing, and other engineering standard processes
  • Effective communication, collaboration, and social skills
  • Result oriented approach.
  • Good English (oral & written) and communication skills in general.
  • Experience in AWS.

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer :

  • Collaborating with teams of creative, fun, and driven colleagues
  • Flexible work options enabling time and location-based flexibility
  • Company-provided home office equipment
  • Virtual collaboration and productivity tools to enable hybrid teams
  • Comprehensive benefits program (Health, Welfare, Retirement and Paid time off)
  • Other perks and wellness benefits like discount programs, and gym / studio access.
  • Paid Parental Leave and coaching, baby welcome gift, and family care / illness days
  • Back-up childcare / elder care, childcare discounts, and subsidized virtual tutoring
  • Tuition assistance and weekly hot skill development opportunities
  • Experiential, high-impact learning series events
  • Access to mental health resources and mindfulness programs
  • Access to join Capgemini Employee Resource Groups around communities of interest
  • 30+ days ago
Related jobs
Promoted
Tactable
Toronto, Ontario

A Data Engineer at Tactable is a professional with a deep understanding of python, data pipelines, and various types of data storage. Work with proprietary tools and technologies including time series databases, job scheduling, cloud storage, containers/images, batch schedulers, and ETL tools. Lead ...

Promoted
Applicantz
Toronto, Ontario

Interface with data engineers, data scientists, product managers and all data stakeholders to understand their needs and promote best practices. As a Data Engineer, you will work to rapidly improve critical data processing & analytics pipelines. As a global leader in 3D design, engineering, and ente...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Architect and develop framework/engine for the next-generation data + AI system. Deep understanding of AI end to end data processing, scenarios and system optimizations. Big Data storage technologies (HDFS, Columnar Database, etc). Principal/Distinguished Engineer. ...

Yelp
Toronto, Ontario
Remote

Develop and maintain the content and structure within data storage solutions including data lakes and data warehouses, ensuring data is accurately organized, enriched, and ready for analysis. You will also develop and maintain our data models, data warehouse, and semantic layer to support analytics ...

HelloFresh
Toronto, Ontario

We are hiring Senior Data Engineers for the Supply Chain Management (SCM) team in North America. Experience with TDD and Data Engineering best practices. The vision for SCM tech is to build the world’s leading, scalable, fully integrated, food supply chain management platform. Our goal is to develop...

E-Solutions
Toronto, Ontario

Building data fictionalization, synthetic data creation, data mining, data sub-setting and data conditioning jobs. Strong understanding of data privacy, data classification and data engineering requirements. Job Title: Test Data Management Engineer. Experienced Test Data Management Engineer:. ...

Astra North Infoteck Inc.
Toronto, Ontario

Strong knowledge of Extraction Transformation and Loading (ETL) processes using frameworks like Azure Data Factory or Synapse or Databricks; establishing the cloud connectivity between different system like ADLS ,ADF, Synapse, Databricks etc. Canditate should demonstrat ability to navigate through m...

Lightspeed
Toronto, Ontario

Utilize various data sources and data preprocessing techniques to ensure data quality and integrity. As a Senior Data Scientist, you will play a crucial role in leveraging data-driven insights to enhance our business strategies, drive innovation, optimize decision-making processes and deploy credit ...

CPP Investments
Toronto, Ontario

Strong programming skills in Python, pyspark, SQL, Java with professional programming experience in a data context is a must ( data extraction, data manipulation, joins, data analysis, data model design etc. As a Lead Data Engineer, you will be working on the Data Service Applications for Public Mar...

RBC - Royal Bank
Mississauga, Ontario

Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis. Assist and participate in data creation, validation and cleaning to ensure the quality and integrity of data through the u...