Talent.com
Egen
Lead Software Engineer - DataEgen • Mississauga, Peel Region, Canada
Lead Software Engineer - Data

Lead Software Engineer - Data

Egen • Mississauga, Peel Region, Canada
30+ days ago
Job type
  • Full-time
Job description

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results.

Our Data Engineering teams build scalable data pipelines using Python, Spark, and cloud services (GCP and AWS). The pipelines we build typically integrate with technologies such as Kafka, Storm, and Elasticsearch. We are working on a continuous deployment pipeline that leverages rapid on-demand releases. Our developers work in an agile process to efficiently deliver high value applications and product packages.

As a Lead Engineer at Egen, you will leverage Spark and GCP (preferred) to architect and implement cloud-native data pipelines and infrastructure to enable analytics and machine learning on rich datasets.

Required Experience:

  • Built and run resilient data pipelines in production and have implemented ETL/ELT to load a multi-terabyte enterprise data warehouse.
  • Implemented analytics applications using multiple database technologies, such as relational, multidimensional (OLAP), key-value, document, or graph.
  • Defined data contracts, and wrote specifications including REST APIs.
  • Transformed data between data models and formats with the most modern PySpark practices. Have built cloud-native applications and supporting technologies / patterns / practices including: Cloud Services, Docker, CI/CD, DevOps, and microservices.
  • Planned and designed artifacts that describe software architectures involving multiple systems and technologiesYou've worked in agile environments and are comfortable iterating quickly.

Nice to have's (but not required):

  • GCP expertise is preferred but will consider AWS
  • Experience moving trained machine learning models into production data pipelines.
  • Experience in biotech, genomics, clinical research or precision medicine.
  • Expert knowledge of relational database modeling concepts, SQL skills, proficiency in query performance tuning, and desire to share knowledge with others.
#J-18808-Ljbffr
Create a job alert for this search

Lead Software Engineer - Data • Mississauga, Peel Region, Canada

Similar jobs

Lead Software Engineer

United States Digital Space LLCMississauga
Full-time

Discover your future at the company.Working at the company is far more than just a job.A career with us means joining a team of more than 230,000 dedicated people from around the globe.At the compa... Show more

 • Promoted

Lead Full-Stack Data Engineer — ETL & Insights

Chord StrategyMississauga, Peel Region, CA
Full-time

A dynamic growth strategy consultancy in Metro Vancouver is seeking a Data Engineer to improve and maintain ETL processes.The ideal candidate is a leader comfortable with ambiguity and able to work... Show more

 • Promoted

Senior Data Engineer - Python, PySpark and OpenShift Lead

Compunnel, Inc.Mississauga, Peel Region, CA
Full-time

A leading data engineering firm is seeking a Data Engineer to design and maintain scalable data pipelines using Python and PySpark.This role requires managing data storage solutions, orchestrating ... Show more

 • Promoted

Senior Data Engineer: Build Scalable Data Platform for ML

MyprosperaMississauga, Peel Region, CA
Full-time

A wealth management technology firm is seeking a Senior Data Engineer to architect and build data infrastructure from scratch.The role requires 5+ years of experience in cloud data warehouses, espe... Show more

 • Promoted

Lead Software Engineer in AI Development

AlphaSenseMississauga, Peel Region, CA
Full-time

Take the lead as a Software Engineer focusing on AI at a premier Market Intelligence firm.Drive innovation and architecture while fostering a collaborative and inclusive workplace.This role seeks c... Show more

 • Promoted

Data Engineer

AltimetrikMississauga, Peel Region, CA
Full-time

Direct message the job poster from Altimetrik.Design, develop, and maintain software solutions using Python.Design, develop, and maintain software solutions using.Develop Python and pyspark program... Show more

 • Promoted

Data Engineer

AccuroMississauga, Peel Region, CA
Full-time +1

Job Title: Big Data Engineer with Strong SQL Exp.Location: Mississauga, ON (Hybrid/ 03 days onsite).Strong Experience in Apache Hadoop, Spark, Spark SQL, Hive, Impala, Yam, Talend.Have strong exper... Show more

 • Promoted

Data Engineer

Nexus Systems Group Inc.Mississauga, Peel region, Canada
Full-time

Location: CAN, Ontario, Toronto, 250 Bloor Street East.Hybrid – onsite 3 days per week.Possibility of extension & conversion to FTE.Schedule Hours: 9am-5pm Monday-Friday; standard 37.Hands-on techn... Show more

 • Promoted

Lead Software Engineer

CitiMississauga
Full-time

The Banking Technology team is at the forefront of digital transformation, committed to enhancing client interactions and improving banker experience through an AI‑first approach to development.We ... Show more

 • Promoted

Data Engineer

JLI Consulting Talent SearchVaughan, York Region, CA
Full-time

Do you love making sure that information is accessible and easy to use? So do we.You are a data engineer who knows how to find, store and present a range of information from.As a Data Engineer, you... Show more

 • Promoted

Senior Data Engineer - Data Governance & Platform Lead

XsollaMississauga, Peel Region, CA
Full-time

A global commerce company in Canada is seeking a Data Engineer to lead efforts in building and optimizing the User Platform and Recommendation Engine.The role involves ensuring data accuracy and pe... Show more

 • Promoted

Data Engineer

ALLTECH CONSULTING SVC INCMississauga
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit... Show more

 • Promoted

Senior Java Data Engineer – Data Platform & Pipelines

PointClickCareMississauga
Full-time

A leading health tech company in Mississauga is seeking a Principal Software Data Engineer to lead the design and enhancement of scalable data solutions.The role demands over 10 years of experience... Show more

 • Promoted

Data Engineer – Senior Level at Roche

RocheMississauga, Peel region, Canada
Full-time

Seek the next step in your career as a Senior Data Engineer at Roche in Mississauga.Collaborate with a diverse team to manage and innovate data pipelines essential for business insights.In this rol... Show more

 • Promoted

Lead Full Stack Software Engineer Procurify

ProcurifyMississauga, Peel Region, CA
Full-time

Take the lead as a Full Stack Software Engineer at Procurify.Drive technical solutions and develop innovative software using Python/Django and TypeScript/React in a collaborative remote environment... Show more

 • Promoted

Remote Lead Data Engineer Specializing in Data Pipeline Architecture

LumenaltaMississauga, Peel region, Canada
Remote
Full-time

Join as a Remote Lead Data Engineer specializing in sophisticated data pipeline architectures.Leverage your technical skills to lead transformative data initiatives while mentoring a team.With over... Show more

 • Promoted

Lead Data Engineer Role at IKO

IKO North AmericaMississauga
Full-time

Join IKO Industries in Mississauga, ON as a Senior Data Engineer, where innovation meets excellence in data engineering.Use your skills to enhance data flows and support strategic decisions.This in... Show more

 • Promoted

Senior Software Engineer, Global Markets Platform Lead

AlpacaMississauga, Peel Region, CA
Full-time

A leading financial technology company is seeking a Senior Engineer to design and maintain systems that empower millions of users.This role requires proven experience in financial systems and the a... Show more

 • Promoted

Data Engineer

TalentOlaMississauga
Full-time

Data Engineer/ Python Developer.Design, develop, and maintain software solutions using Python.Develop Python and pyspark programs for data analysis.Good working experience with Python to develop a ... Show more

 • Promoted

Senior Data & Analytics Engineer

WagepointMississauga, Peel Region, CA
Full-time

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Show more