Lead Data Engineer (AWS/Java/Python)

Motion Recruitment
Chicago, Alberta, Canada
$150K-$170K a year
Full-time

We’re looking for a Lead Data Engineer to join a Chicago-based Financial services company. This role offers hybrid work with remote flexibility.

You will be part of a close-knit group that embodies a startup culture within a larger enterprise.

The team is dedicated to developing and enhancing their high-volume and complex latency fraud processing platform. As a Lead Data Engineer, you will be at the forefront of building real-time, low-latency streaming solutions to scale their fraud-detection capabilities.

Required Skills & Experience

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or related field.
  • 5+ years of software development experience, focusing on scalable data platforms.
  • Expertise in designing, developing, optimizing, and maintaining data pipelines using AWS services.
  • Experience in building modern data lakes and understanding data platforms & services strategies.
  • Ability to foster a culture of sharing, re-use, and operational efficiency in data solutions.
  • Experience leading the evaluation and implementation of emerging tools to modernize data platforms.
  • Ability to work with analysts and architects to develop technical architectures for data engineering projects.

Desired Skills & Experience

  • 6+ years of overall technology experience, including 4+ years of hands-on software development, data engineering, and systems architecture.
  • Experience with AWS services such as Lambda, Glue, S3, Redshift, EMR, and Kinesis.
  • Thorough understanding of Data Lake architectures and ETL / ELT operations.
  • Proficiency in Java, Python, Spark, PySpark, and Hadoop distributions.
  • Hands-on experience with streaming technologies like Kafka or MapR.

You will receive the following benefits :

  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k) including match- if applicable

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

LI-GF1

30+ days ago
Related jobs
Motion Recruitment
Chicago, Alberta, Canada

We’re looking for a Lead Data Engineer to join a Chicago-based Financial services company. As a Lead Data Engineer, you will be at the forefront of building real-time, low-latency streaming solutions to scale their fraud-detection capabilities. Expertise in designing, developing, optimizing, and mai...

Promoted
Scotiabank
Canada

You will lead a team of engineers, collaborate with cross-functional teams including data architects, solution architects, business systems analysts and data engineers and ensure that our data infrastructure is robust, secure, and optimized for performance. Lead in designing and building production ...

Motion Recruitment
Chicago, Alberta, Canada

We’re looking for a Lead Data Engineer to join a Chicago-based Financial services company. As a Lead Data Engineer, you will be at the forefront of building real-time, low-latency streaming solutions to scale their fraud-detection capabilities. Expertise in designing, developing, optimizing, and mai...

Promoted
Orennia
Calgary, Alberta

As a Lead Data Engineer, you will play a crucial role in leading our engineering team alongside our product and analytics teams to develop highly scalable, high-quality data products using engineering best practices. Provide technical leadership to design and develop data and analytics engineering p...

Promoted
Bombardier Transportation GmbH
Canada

Define and operate the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL and ‘big data’ technologies as needed (Hadoop, MapReduce, Hive, Spark, Kafka, Pig, data streaming, NoSQL, SQL, programming). You have good kn...

New Relic, Inc.
Calgary, Alberta
Remote

Lead Software Engineer - Java (Remote). Lead Software Engineer - Java (Remote). Lead Software Engineer Req ID 3 Location(s) Calgary, Canada; Montreal, Canada; Ottawa, Canada; Toronto, Canada; Vancouver, Canada; Work arrangement(s) Fully Remote (works exclusively from home) Your opportunity At New Re...

Data Theorem
Calgary, Alberta

As a Senior Python Backend Engineer, you will be responsible for implementing web services, libraries and tools in Python, in order to automate the security analysis of mobile, cloud and web applications, at scale. Data Theorem is an exciting company focused on creating a more secure world for data....

S.i. Systems
Calgary, Alberta

Staff Software Engineer with Java (Springboot) to build out features on a Master Data Management product from start to finish. ...

Promoted
Apex Systems Inc
Canada

Apex Systems is a global IT services provider, and our staffing practice has an opening for a Senior Python Developer with Capital Markets experience, and extensive background in Python and Java to he. ...

Promoted
Insight Global
Canada
Remote

Experience in Python Development. ...