Talent.com
Scotiabank
Lead Software Engineer (Python | Databricks)Scotiabank • Toronto, ON, CA
Lead Software Engineer (Python | Databricks)

Lead Software Engineer (Python | Databricks)

Scotiabank • Toronto, ON, CA
30+ days ago
Job type
  • Full-time
Job description

Is this role right for you?

In this role you will:
  • Work closely with end users, and business teams to understand business needs, conduct gap analysis and requirements assessments as needed
  • Partner with Architecture on the design and integration
  • Deliver and enhance new and current solutions and applications
  • Be involved in the full life cycle of a project, responsible for the design, producing actionable and complete specifications, writing production quality code, and implementation
  • Design, deliver and implement data models, database schema and data pipelines
  • Design test sets and automate where possible, including functional and non functional testing, regression testing as well as performance testing
  • Write deployment scripts and leverage tools such as the Accelerator pipeline to promote code
  • Support the solution in production (as needed)
  • Improve the end user experience by finding scalable solutions and addressing complex ad hoc queries.
  • Effectively communicate with technical and non-technical audiences
  • Able to work with and refactor legacy code (as needed).
  • Coach and train end users (as needed).
  • Participate and run SCRUM Meetings (as needed).

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:

  • 4+ years’ experience with Python (PySpark, Pandas),
  • 4+ years’ experience with designing scalable ETL pipelines & data modeling
  • 4+ years’ experience developing, deploying, and maintaining large scale applications with complex integration
  • 4 + years’ experience reading, writing, and running SQL scripts.
  • Working experience with data technologies and databases, preferably in one or more of: Postgres, MSSQL, Oracle DB, Apache Spark, Apache Kafka, Apache ElasticSearch, comfortable working with large datasets
  • Working experience with data platforms: DataBricks or Snowflake
  • Working experience with cloud platforms (Azure/GCP)
  • Working experience with workflow orchestration tool such as Airflow or Data Factory
  • Working experience with Web Services & API
  • Hands-on experience with DevOps: CI/CD (Jenkins, Git)
  • Experience working in an Agile environment, with experience and understanding of Test-Driven Development methodology.
  • Bachelor’s degree in computer science, Engineering or relevant experience.

Preferred Qualifications (Nice to have)

  • Understanding of networking protocols and security principles
  • Capital Markets product knowledge
  • Dockers, Kubernetes experience
  • Experience working with real-time, high availability and low latency systems
  • Experience in multi-threaded applications

What's in it for you?

  • Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
  • Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove, and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
  • Community Engagement - no matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.

#LI-Hybrid

Create a job alert for this search

Lead Software Engineer (Python | Databricks) • Toronto, ON, CA

Similar jobs

Senior Software Engineer Leading Python Applications for Investments

CollaberaToronto, ON, CA
Full-time

Lead the charge as a Senior Software Engineer, focusing on Python and AWS, while building impactful internal tools for the investments industry.Innovate data visualization applications that elevate... Show more

 • Promoted

Senior Software Engineer (Python)

VaronisToronto, Ontario, Canada
Full-time

Senior Software Engineer – Secure AI Platform (Vancouver, On-Site).The Company: Varonis (Nasdaq: VRNS) is a leader in data security, fighting a different battle than conventional cybersecurity comp... Show more

 • Promoted

Senior Python Software Engineer - Toronto - $100,000 - $150,000 A Year

ValidusToronto, Canada
Full-time

Seeking a financial software engineer for a back-end team designing and maintaining systems for a trading platform.Responsibilities include stakeholder engagement, data integration, cloud-native de... Show more

 • Promoted

Senior Software Engineer for Cutting-Edge Data Infrastructure

AutodeskToronto, ON, CA
Full-time

Transform how data infrastructure is built as a Senior Software Engineer.Play a crucial role in developing AI-native, scalable systems that advance our capabilities across analytics and insights.Th... Show more

 • Promoted

Senior FinTech Backend Engineer & Data Pipelines Lead

AgodaToronto, ON, CA
Full-time

A global travel company is seeking a Staff Software Engineer (FinTech) to join their team in Bangkok, with relocation provided.The ideal candidate will have over 8 years of experience in Java, Kotl... Show more

 • Promoted

Senior Software Engineer Specializing in Python and AWS Architecture

Scribd, Inc.Toronto, ON, CA
Full-time

Take your engineering expertise to the next level as a Senior Software Engineer.Design event-driven systems in Python and work with cloud technologies to enrich metadata on a global scale.This posi... Show more

 • Promoted

Senior Software Engineer (Python + Distributed systems)

Scribd, Inc.Toronto, ON, CA
Full-time

Our four products — Scribd®, Slideshare®, Everand™, and Fable — help billions of people across the globe move beyond access and into insight, application, and expertise.We support a culture where o... Show more

 • Promoted

Senior Software Engineer - Fintech, Scale Big Data (AWS)

d1g1tToronto, ON, CA
Full-time

A leading fintech startup in Toronto is seeking a Senior Software Engineer to drive projects from implementation to deployment.The ideal candidate will have strong expertise in Python and Django, h... Show more

 • Promoted

Software Engineer

businessToronto, ON, CA
Full-time

HireArt is helping our client find Software Engineers to design and develop AI-powered systems and applications that leverage large language models and modern machine learning frameworks.In this ro... Show more

 • Promoted

Senior Data Engineer & ETL Architect (Snowflake + Python)

HRbrain Inc.Toronto, ON, CA
Full-time

Senior Data Engineer, 10+ years Experience.For ESG (Environmental and sustainability) Project: will want this person to do actual engineering.They will be creating from scratch- pure through and th... Show more

 • Promoted

Senior Data Platform Engineer - Databricks & Pipelines

MaintainXToronto, ON, CA
Full-time

A leading Asset and Work Intelligence platform is seeking a Senior Data Developer to enhance their data platform utilized for critical internal analytics.The role requires over 6 years of experienc... Show more

 • Promoted

Lead Software Engineer (Python | Databricks)

ScotiabankToronto
Full-time

Lead Software Engineer (Python | Databricks).Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Global Banking and Markets Engineering (GBME) is t... Show more

 • Promoted

Lead Full-Stack Engineer — Python & FastAPI

EPAM SystemsToronto, ON, CA
Full-time

A leading technology company in Toronto is looking for a Lead Full Stack Development Engineer to enhance its Technology & Operations team.The ideal candidate will have over 4 years of experience in... Show more

 • Promoted

Software Engineer, Python

AutoSyncGreater Toronto Area, ON, CA
Full-time

TRADER Corporation is a trusted Canadian leader in online media, dealer and lender services.AutoSync, and Dealertrack Canada.Quebec) offers the largest inventory of new and used cars in Canada, wit... Show more

 • Promoted

Data Engineer (Python and AWS)

Iris Software Inc.Toronto, ON, CA
Full-time

Data Engineer (Python and AWS).Toronto, ON (Hybrid, 3 days onsite).Hands‑on experience with AWS services (EC2, Lambda, S3, RDS, IAM, CloudWatch).Strong understanding of RESTful APIs and microservic... Show more

 • Promoted

Data Enablement Lead Engineer for Enterprise Platforms and APIs

Canada Pension Plan Investment BoardToronto, ON, CA
Full-time

Drive enterprise data strategy as a Lead Engineer in Data Enablement.Innovate secure and scalable backend services and tools to enhance user access and governance for data products in a hybrid sett... Show more

 • Promoted

Senior Software Engineer — Lead High-Impact, Remote/Hybrid

AchieversToronto, ON, CA
Remote
Full-time

A leading employee recognition platform in Canada seeks a Senior Software Engineer to drive product impact at a global scale.The role offers hybrid or remote work options.Responsibilities include l... Show more

 • Promoted

Senior Python Software Engineer - (Data&Connectors)

DataRobotToronto, ON, CA
Full-time

DataRobot delivers AI that maximizes impact and minimizes business risk.Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale.Da... Show more

 • Promoted

Lead Software Engineering Role At Pheedloop

PheedlooToronto, Canada
Full-time

Shape the future of event technology as a Lead Software Engineer at PheedLoop in Toronto, ON.This hybrid position blends technical prowess with leadership in Python/Django and React projects.PheedL... Show more

 • Promoted

Senior Software Engineer - Data Platform

HRBToronto, ON, CA
Full-time

We’re looking for an engineer who thrives on building scalable data platforms and enjoys tackling complex backend challenges.This isn’t just a data engineering role, you’ll be designing and optimiz... Show more