Talent.com
Scotiabank
Lead Software Engineer (Python | Databricks)Scotiabank • Toronto, ON, CA
Lead Software Engineer (Python | Databricks)

Lead Software Engineer (Python | Databricks)

Scotiabank • Toronto, ON, CA
30+ days ago
Job type
  • Full-time
Job description

Is this role right for you?

In this role you will:
  • Work closely with end users, and business teams to understand business needs, conduct gap analysis and requirements assessments as needed
  • Partner with Architecture on the design and integration
  • Deliver and enhance new and current solutions and applications
  • Be involved in the full life cycle of a project, responsible for the design, producing actionable and complete specifications, writing production quality code, and implementation
  • Design, deliver and implement data models, database schema and data pipelines
  • Design test sets and automate where possible, including functional and non functional testing, regression testing as well as performance testing
  • Write deployment scripts and leverage tools such as the Accelerator pipeline to promote code
  • Support the solution in production (as needed)
  • Improve the end user experience by finding scalable solutions and addressing complex ad hoc queries.
  • Effectively communicate with technical and non-technical audiences
  • Able to work with and refactor legacy code (as needed).
  • Coach and train end users (as needed).
  • Participate and run SCRUM Meetings (as needed).

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:

  • 4+ years’ experience with Python (PySpark, Pandas),
  • 4+ years’ experience with designing scalable ETL pipelines & data modeling
  • 4+ years’ experience developing, deploying, and maintaining large scale applications with complex integration
  • 4 + years’ experience reading, writing, and running SQL scripts.
  • Working experience with data technologies and databases, preferably in one or more of: Postgres, MSSQL, Oracle DB, Apache Spark, Apache Kafka, Apache ElasticSearch, comfortable working with large datasets
  • Working experience with data platforms: DataBricks or Snowflake
  • Working experience with cloud platforms (Azure/GCP)
  • Working experience with workflow orchestration tool such as Airflow or Data Factory
  • Working experience with Web Services & API
  • Hands-on experience with DevOps: CI/CD (Jenkins, Git)
  • Experience working in an Agile environment, with experience and understanding of Test-Driven Development methodology.
  • Bachelor’s degree in computer science, Engineering or relevant experience.

Preferred Qualifications (Nice to have)

  • Understanding of networking protocols and security principles
  • Capital Markets product knowledge
  • Dockers, Kubernetes experience
  • Experience working with real-time, high availability and low latency systems
  • Experience in multi-threaded applications

What's in it for you?

  • Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
  • Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove, and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
  • Community Engagement - no matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.

#LI-Hybrid

Create a job alert for this search

Lead Software Engineer (Python | Databricks) • Toronto, ON, CA

Similar jobs

Senior Python Engineer (Toronto)

Fitch GroupToronto, Ontario, Canada
Full-time

This job is with Fitch Group, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.Senior Softw... Show more

 • Promoted

Senior Python Software Engineer - Toronto - $100,000 - $150,000 A Year

ValidusToronto, Canada
Full-time

Validus is looking for a financial software engineer to join our back-end team.This team is responsible for designing, implementing, and maintaining the systems and services powering the rapidly gr... Show more

 • Promoted

Senior Software Engineer - Fintech, Scale Big Data (AWS)

d1g1tToronto, ON, CA
Full-time

A leading fintech startup in Toronto is seeking a Senior Software Engineer to drive projects from implementation to deployment.The ideal candidate will have strong expertise in Python and Django, h... Show more

 • Promoted

Python Engineer - Analytics

Ample Insight Inc.Toronto, ON, CA
Full-time

We are looking for an ambitious Python Engineer/Developer.You are passionate about technology but very pragmatic in the application of it to real-world engineering problems.You are experienced in l... Show more

 • Promoted

Lead Full Stack Software Engineer Procurify

ProcurifyToronto, ON, CA
Full-time

Take the lead as a Full Stack Software Engineer at Procurify.Drive technical solutions and develop innovative software using Python/Django and TypeScript/React in a collaborative remote environment... Show more

 • Promoted

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

CanonicalToronto, Ontario, Canada
Full-time

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics.Python and Kubernetes Software Engineer - Data, AI/ML & Analytics.Python and Kubernetes Software Engineer - Data, AI/ML & Analytics... Show more

 • Promoted

Lead Engineer (Python and Capital Markets)

CollaberaToronto
Full-time +1

Lead Engineer (Python and Capital Markets).This range is provided by Collabera.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message th... Show more

 • Promoted

Senior Python Lead Engineer For Scalable Manufacturing Ops - C$95,000 - C$115,000 A Year

Longboard Architectural ProductsEast York, Canada
Full-time

Lead a software engineering team in developing vital operational solutions, focusing on Python and ReactJS.Requires 5+ years of experience and leadership skills. Show more

 • Promoted

Lead Software Engineer (Python | Databricks)

ScotiabankToronto
Full-time

Lead Software Engineer (Python | Databricks).Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Global Banking and Markets Engineering (GBME) is t... Show more

 • Promoted

Senior Python Software Engineer

Quantum Technology Recruiting Inc. (QTR)Toronto, Ontario, Canada
Permanent

Downtown Toronto, Hybrid/Onsite.We're partnering with a growing financial technology firm looking to add a Senior Backend Engineer to their engineering team in Toronto.This position focuses on buil... Show more

 • Promoted

Lead Python Platform Engineer

Insight GlobalToronto, Ontario, Canada
Full-time +1

This range is provided by Insight Global.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Insight Global.Profe... Show more

 • Promoted

Senior Software Engineer in Python Development

VySystemsToronto, ON, CA
Full-time

Drive innovation as a Senior Software Engineer specializing in Python.Contribute to a scalable microservices banking platform while fostering a collaborative team environment.This role is perfect f... Show more

 • Promoted

Software Engineer, Python

AutoSyncGreater Toronto Area, ON, CA
Full-time

TRADER Corporation is a trusted Canadian leader in online media, dealer and lender services.AutoSync, and Dealertrack Canada.Quebec) offers the largest inventory of new and used cars in Canada, wit... Show more

 • Promoted

Staff Software Engineer, Data Systems (Python) - $190,000 - $220,000 A Year

NorthbeamNorth York, Canada
Full-time

Seeking a Staff Software Engineer, Data Systems (Python) to build and maintain scalable data pipelines and products.Responsibilities include data ingestion, optimization, and integration with ML/da... Show more

 • Promoted

Data Engineer (Python and AWS)

Iris Software Inc.Toronto, ON, CA
Full-time

Data Engineer (Python and AWS).Toronto, ON (Hybrid, 3 days onsite).Hands‑on experience with AWS services (EC2, Lambda, S3, RDS, IAM, CloudWatch).Strong understanding of RESTful APIs and microservic... Show more

 • Promoted

Senior Software Engineer

Morningstar Credit Ratings, LLCToronto, Canada
Full-time

About the RoleAs a Senior Software Engineer, you will work closely with product owners, engineering teams, and technical leads on our next generation data feed platform.This role is primarily focus... Show more

 • Promoted

Lead Software Engineer for Investment Technology

CPP Investments | Investissements RPCToronto, ON, CA
Full-time

Join CPP Investments as a Lead Software Engineer focused on technology solutions for Capital Markets.Utilize your software engineering prowess to enhance investment strategies and efficiencies.This... Show more

 • Promoted

Data Engineer (Python/Spark)

Take-Two InteractiveToronto, ON, CA
Full-time

Headquartered in New York City, Take-Two Interactive Software, Inc.We develop and publish products principally through Rockstar Games, 2K, and Zynga.Our strategy is to create hit entertainment expe... Show more

 • Promoted • New!

Lead Software Engineer - C$160,000 - C$170,000 A Year

CPP InvestmentsNorth York, Canada
Full-time

Lead Software Engineer responsible for designing and architecting Python applications and APIs for investment research and analytics, leveraging AWS cloud.This is a hands-on technical leadership role. Show more

 • Promoted

Lead Software Engineer - DB2 developer

Tek Leaders IncToronto, ON, CA
Temporary

Data-Other DWH Database with Data Modelling, ETL.We are looking for an experienced.The role requires the candidate to understand the landscape of the application and the data, including its topolog... Show more