Lead Data Engineer (AWS/Java/Python)

Motion Recruitment
Chicago, Alberta, Canada
$150K-$170K a year
Full-time

We’re looking for a Lead Data Engineer to join a Chicago-based Financial services company. This role offers hybrid work with remote flexibility.

You will be part of a close-knit group that embodies a startup culture within a larger enterprise.

The team is dedicated to developing and enhancing their high-volume and complex latency fraud processing platform. As a Lead Data Engineer, you will be at the forefront of building real-time, low-latency streaming solutions to scale their fraud-detection capabilities.

Required Skills & Experience

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or related field.
  • 5+ years of software development experience, focusing on scalable data platforms.
  • Expertise in designing, developing, optimizing, and maintaining data pipelines using AWS services.
  • Experience in building modern data lakes and understanding data platforms & services strategies.
  • Ability to foster a culture of sharing, re-use, and operational efficiency in data solutions.
  • Experience leading the evaluation and implementation of emerging tools to modernize data platforms.
  • Ability to work with analysts and architects to develop technical architectures for data engineering projects.

Desired Skills & Experience

  • 6+ years of overall technology experience, including 4+ years of hands-on software development, data engineering, and systems architecture.
  • Experience with AWS services such as Lambda, Glue, S3, Redshift, EMR, and Kinesis.
  • Thorough understanding of Data Lake architectures and ETL / ELT operations.
  • Proficiency in Java, Python, Spark, PySpark, and Hadoop distributions.
  • Hands-on experience with streaming technologies like Kafka or MapR.

You will receive the following benefits :

  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k) including match- if applicable

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

LI-GF1

30+ days ago
Related jobs
Motion Recruitment
Chicago, Alberta, Canada

We’re looking for a Lead Data Engineer to join a Chicago-based Financial services company. As a Lead Data Engineer, you will be at the forefront of building real-time, low-latency streaming solutions to scale their fraud-detection capabilities. Expertise in designing, developing, optimizing, and mai...

S.i. Systems
Edmonton, Alberta

Staff Software Engineer with Java (Springboot) to build out features on a Master Data Management product from start to finish. ...

New Relic, Inc.
Calgary, Alberta
Remote

Lead Software Engineer - Java (Remote). Lead Software Engineer - Java (Remote). Lead Software Engineer Req ID 3 Location(s) Calgary, Canada; Montreal, Canada; Ottawa, Canada; Toronto, Canada; Vancouver, Canada; Work arrangement(s) Fully Remote (works exclusively from home) Your opportunity At New Re...

Data Theorem
Calgary, Alberta

As a Senior Python Backend Engineer, you will be responsible for implementing web services, libraries and tools in Python, in order to automate the security analysis of mobile, cloud and web applications, at scale. Data Theorem is an exciting company focused on creating a more secure world for data....

Promoted
Crossover
Edmonton, Alberta
Remote

AI tools, ability to automate workflows and custom GPTs); if you've only used LLMs for research, learning, brainstorming, or content generation, that will be deemed insufficient. ...

Promoted
Alignerr
Wood Buffalo, Alberta, Canada
Remote

As an AI Tutor - Coding, you'll play a critical role in shaping the future of AI.You'll leverage your subject-matter expertise to train and evaluate AI models, ensuring the information they generate is reliable and relevant across various domains.This position offers a unique path for professional g...

Deloitte
Calgary, Alberta

The data governance and data quality engineer is an individual contributor that provides specialized technical and functional expertise that works in collaboration with functional teams and stakeholders to modeling, developing, enhancing and deploying technical components related to the data governa...

Instacart
Canada
Remote

As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and product leaders as part of your team. You will use machine learning to devise and refine solutions in crucial areas such as ads selection, ranking, auction, and pricing across all of Instac...

Leap Tools
Canada

Your expertise in Machine Learning isn't just about models and algorithms; it's about driving tangible, user-centric solutions. You have read papers on machine learning topics and implemented your own versions of the papers. You thrive when you're pushing the boundaries of what Machine Learning can ...

Leica Geosystems
Canada

Senior DevOps Engineer / Site Reliability. As a Senior DevOps/SRE Engineer, you will help build solutions that allow our cloud-based platform, HxDR, to continue to evolve and grow through both technological and organizational transformations. DevOps &/or Site Reliability Engineering principles. Seni...