Talent.com
Egen
Lead Software Engineer - DataEgen • Mississauga, Peel Region, Canada
Lead Software Engineer - Data

Lead Software Engineer - Data

Egen • Mississauga, Peel Region, Canada
30+ days ago
Job type
  • Full-time
Job description

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results.

Our Data Engineering teams build scalable data pipelines using Python, Spark, and cloud services (GCP and AWS). The pipelines we build typically integrate with technologies such as Kafka, Storm, and Elasticsearch. We are working on a continuous deployment pipeline that leverages rapid on-demand releases. Our developers work in an agile process to efficiently deliver high value applications and product packages.

As a Lead Engineer at Egen, you will leverage Spark and GCP (preferred) to architect and implement cloud-native data pipelines and infrastructure to enable analytics and machine learning on rich datasets.

Required Experience:

  • Built and run resilient data pipelines in production and have implemented ETL/ELT to load a multi-terabyte enterprise data warehouse.
  • Implemented analytics applications using multiple database technologies, such as relational, multidimensional (OLAP), key-value, document, or graph.
  • Defined data contracts, and wrote specifications including REST APIs.
  • Transformed data between data models and formats with the most modern PySpark practices. Have built cloud-native applications and supporting technologies / patterns / practices including: Cloud Services, Docker, CI/CD, DevOps, and microservices.
  • Planned and designed artifacts that describe software architectures involving multiple systems and technologiesYou've worked in agile environments and are comfortable iterating quickly.

Nice to have's (but not required):

  • GCP expertise is preferred but will consider AWS
  • Experience moving trained machine learning models into production data pipelines.
  • Experience in biotech, genomics, clinical research or precision medicine.
  • Expert knowledge of relational database modeling concepts, SQL skills, proficiency in query performance tuning, and desire to share knowledge with others.
#J-18808-Ljbffr
Create a job alert for this search

Lead Software Engineer - Data • Mississauga, Peel Region, Canada

Similar jobs

Lead Software Engineer

United States Digital Space LLCMississauga
Full-time

Discover your future at the company.Working at the company is far more than just a job.A career with us means joining a team of more than 230,000 dedicated people from around the globe.At the compa... Show more

 • Promoted

Lead Software Engineer in AI Development

AlphaSenseMississauga, Peel region, Canada
Full-time

Take the lead as a Software Engineer focusing on AI at a premier Market Intelligence firm.Drive innovation and architecture while fostering a collaborative and inclusive workplace.This role seeks c... Show more

 • Promoted

Lead Full-Stack Data Engineer — ETL & Insights

Chord StrategyMississauga, Peel Region, CA
Full-time

A dynamic growth strategy consultancy in Metro Vancouver is seeking a Data Engineer to improve and maintain ETL processes.The ideal candidate is a leader comfortable with ambiguity and able to work... Show more

 • Promoted

Senior Data Engineer - Python, PySpark and OpenShift Lead

Compunnel, Inc.Mississauga, Peel Region, CA
Full-time

A leading data engineering firm is seeking a Data Engineer to design and maintain scalable data pipelines using Python and PySpark.This role requires managing data storage solutions, orchestrating ... Show more

 • Promoted

Data Engineer

AltimetrikMississauga, Peel Region, CA
Full-time

Direct message the job poster from Altimetrik.Design, develop, and maintain software solutions using Python.Design, develop, and maintain software solutions using.Develop Python and pyspark program... Show more

 • Promoted

Data Engineer

Nexus Systems Group Inc.Mississauga, Peel region, Canada
Full-time

Location: CAN, Ontario, Toronto, 250 Bloor Street East.Hybrid – onsite 3 days per week.Possibility of extension & conversion to FTE.Schedule Hours: 9am-5pm Monday-Friday; standard 37.Hands-on techn... Show more

 • Promoted

Senior Software Engineer

AOSgrimsby, niagara region, Canada
Full-time

At AOS, we help companies use technology to improve productivity, streamline operations, reduce costs, and create peace of mind.Through our managed services, office technology solutions, and techno... Show more

 • Promoted

Lead Software Engineer

CitiMississauga
Full-time

The Banking Technology team is at the forefront of digital transformation, committed to enhancing client interactions and improving banker experience through an AI‑first approach to development.We ... Show more

 • Promoted

Python And Kubernetes Software Engineer - Data, Ai/Ml & Analytics

CanonicalMississauga, Canada
Full-time

Python and Kubernetes Software Engineer - Data, AI/ML & AnalyticsJoin to apply for the Python and Kubernetes Software Engineer - Data, AI/ML & Analytics role at CanonicalPython and Kubernet... Show more

 • Promoted

Senior Data Engineer - Data Governance & Platform Lead

XsollaMississauga, Peel Region, CA
Full-time

A global commerce company in Canada is seeking a Data Engineer to lead efforts in building and optimizing the User Platform and Recommendation Engine.The role involves ensuring data accuracy and pe... Show more

 • Promoted

Data Engineer

ALLTECH CONSULTING SVC INCMississauga
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit... Show more

 • Promoted

Senior Java Data Engineer – Data Platform & Pipelines

PointClickCareMississauga
Full-time

A leading health tech company in Mississauga is seeking a Principal Software Data Engineer to lead the design and enhancement of scalable data solutions.The role demands over 10 years of experience... Show more

 • Promoted

Senior Software Engineer — Tech Leader & Impact

Alternative PaymentsMississauga, Peel Region, CA
Full-time

A dynamic fintech company based in Canada seeks a Lead Software Engineer to drive technical excellence in their platform.This role emphasizes designing scalable microservices and leading cross-func... Show more

 • Promoted

Lead Software Engineer - AI and SaaS

Human AgencyMississauga, Peel region, Canada
Full-time

Take the lead as a Software Engineer, specializing in AI and SaaS application development.Tackle backend and frontend challenges while driving innovative solutions for complex enterprise problems.I... Show more

 • Promoted

Lead Full Stack Software Engineer Procurify

ProcurifyMississauga, Peel Region, CA
Full-time

Take the lead as a Full Stack Software Engineer at Procurify.Drive technical solutions and develop innovative software using Python/Django and TypeScript/React in a collaborative remote environment... Show more

 • Promoted

Remote Lead Data Engineer Specializing in Data Pipeline Architecture

LumenaltaMississauga, Peel region, Canada
Remote
Full-time

Join as a Remote Lead Data Engineer specializing in sophisticated data pipeline architectures.Leverage your technical skills to lead transformative data initiatives while mentoring a team.With over... Show more

 • Promoted

Data Engineer

AccuroMississauga
Full-time +1

Job Title: Big Data Engineer with Strong SQL Exp.Location: Mississauga, ON (Hybrid/ 03 days onsite).Strong Experience in Apache Hadoop, Spark, Spark SQL, Hive, Impala, Yam, Talend.Have strong exper... Show more

 • Promoted

Senior Data Engineer

Insight GlobalVaughan, York Region, CA
Full-time

This Senior Data Engineer will be responsible for designing, building, and optimizing high-performance data pipelines and platforms within a Databricks and AWS environment.The team is currently in ... Show more

 • Promoted

Lead Data Engineer Role at IKO

IKO North AmericaMississauga
Full-time

Join IKO Industries in Mississauga, ON as a Senior Data Engineer, where innovation meets excellence in data engineering.Use your skills to enhance data flows and support strategic decisions.This in... Show more

 • Promoted

Senior Software Engineer, Global Markets Platform Lead

AlpacaMississauga, Peel Region, CA
Full-time

A leading financial technology company is seeking a Senior Engineer to design and maintain systems that empower millions of users.This role requires proven experience in financial systems and the a... Show more