Search jobs > Toronto, ON > Senior data engineer

Senior Data Engineer - Tech Lead

Lyons Consulting Group
Toronto, ON, CA
$84 an hour (estimated)
Full-time

Job Description

As a Team Lead, you will build distributed data processing solution and highly loaded database solutions for various cases including reporting, product analytics, marketing optimization and financial reporting.

Manage a team of authority data engineers working on the foundation for decision-making at a company dealing with billions of events per day.

Supply as part of R&D self-organized team working in an ambitious, innovative environment for our client. Investigate, create, and implement the solutions for existing technical challenges.

Provide guidance, instruction, direction, leadership to a development team with the purpose of achieving project goals.

Responsibilities :

  • Coordinates the work of direct subordinates.
  • Ensures effective communication between all customers related to team’s area of responsibility and deliveries.
  • Ensure high quality development standards (unit / integration tests, etc.)
  • Makes team to work according to development process established on the project / within the team to take end-to-end ownership on their AOR and tasks.
  • Reports about area readiness / quality and raises red flags in crisis situations beyond their AOR.
  • Responsible for resolving crisis situations within their AOR!
  • Participates in software development implementation work.
  • Prepares functional and design specifications of computer-based systems.
  • Mentors more junior team members.
  • Ensures the project team is provided with all required technical tools for efficient project delivery.
  • Responsible for accurate vacation, holiday planning and forecasts of a team according to delivery landmarks and releases.
  • Coordinates and evaluates team members’ performance according to established procedures.
  • Participates in interview process for the recruitment of new team members.

Required Skills :

  • University degree in Computer Related Sciences or similar
  • 8+ Year of experience as Data Engineer Tech Lead
  • 5+ years of professional experience with strong Python & Pyspark coding skill.
  • 3+ years' experience working in data migration.
  • 3+ years of experience in ETL orchestration and workflow management tools like Airflow, or Oozie.
  • Experience in Spark, Snowflake & Databricks.
  • Guide in Database fundamentals, SQL and distributed computing
  • Excellent communication skills and experience working with technical and non-technical teams.
  • 2+ years of confirmed experience leading other specialists.
  • Able to clear hacker rank code test.

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer :

  • Collaborating with teams of creative, fun, and driven colleagues
  • Flexible work options enabling time and location-based flexibility.
  • Company-provided home office equipment
  • Virtual collaboration and productivity tools to enable hybrid teams.
  • Comprehensive benefits program (Health, Welfare, Retirement and Paid time off)
  • Other perks and wellness benefits like discount programs, and gym / studio access.
  • Paid Parental Leave and coaching, baby welcome gift, and family care / illness days
  • Back-up childcare / elder care, childcare discounts, and subsidized virtual tutoring
  • Tuition assistance and weekly hot skill development opportunities
  • Experiential, high-impact learning series events
  • Access to mental health resources and mindfulness programs
  • Access to join Capgemini Employee Resource Groups around communities of interest.

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society.

It is a responsible and diverse group of , team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs.

It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem.

The Group reported global revenues of €22.5 billion.

Get The Future You Want

Disclaimer

30+ days ago
Related jobs
GHD
Markham, Ontario

Bachelor's degree in civil engineering, Geotechnical Engineering or related subject area along with a master’s degree in Tunnel/Geotechnical Engineering will be an asset. GHD is proud to have one of North America’s largest tunnel design practices and GHD has an excellent opportunity for a Senior Tun...

FICO
Work from Home, Canada
Remote

As a Frontend/UI Engineer you will define, develop, and shape the future of FICO's Fraud Solutions. You will work on the latest UI tech stack to build micro-frontends and reusable components. Director, Software Engineering. ...

Aritzia
Vaughan, Ontario

Proven skills, education, and/or applicable certifications in: Experience creating custom data visualizations and data experiences using modern tools (Tableau, Looker, Power BI)Ability to lead the design process from ideation to polished design, using sketches, wireframes, UX scenarios and mockups t...

StackAdapt
Canada

We're looking to add Senior and Staff Data Engineers to our data science team! This team works on solving complex problems for StackAdapt's digital advertising platform. You'll be working directly with our data scientists, data engineers, Engineering team, and CTO on building pipelines and ad optimi...

RBC - Royal Bank
Toronto, Ontario

E2E technical competency including conducting data analysis, data preprocessing, and feature engineering to prepare datasets for model training. Senior Machine Learning and Data Engineer is responsible for developing application for large-scale data processing and analysis. Work alongside data scien...

Lorven Technologies
Toronto, Ontario

Role: Senior BIG Data Engineer. Write SQL queries to extract data from the data warehouse - hands on experience. Create data definitions for new database files or alterations made to the already existing ones for analysis purposes. SCALA, Java, Hive, Biga Data, SPAK, HDFS, Unix shell scripting, SQL,...

Rackspace
Remote, Canada
Remote

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. Technical degree: Computer Science, Software Engineering or re...

Scotiabank
Toronto, Ontario

Document data engineering processes, creating data flow diagrams, and maintaining metadata for data lineage and cataloging. Data Engineer role will be responsible for designing, building, monitoring, tuning, and troubleshooting data pipelines for Global Finance & Risk Technology. Stay current wi...

Bombarbier
Mississauga, Ontario

Define and operate the infrastructure required for optimal extraction, transformation and loading (ETL) of data from a wide variety of data sources using SQL and ‘big data’ technologies as needed (Hadoop, MapReduce, Hive, Spark, Kafka, Pig, data streaming, NoSQL, SQL, programming) . Work with stakeh...

Figment
Toronto, Ontario

Lead the development and maintenance of data pipelines and ETL processes using technologies such as Dagster and DBT to ensure efficient data flow and processing. Lead the design and implementation of reliable data pipelines and data storage solutions. Lead the implementation of data modeling and int...