Talent.com
Scotiabank
Lead Software Engineer (Python | Databricks)Scotiabank • Toronto, ON, CA
Lead Software Engineer (Python | Databricks)

Lead Software Engineer (Python | Databricks)

Scotiabank • Toronto, ON, CA
30+ days ago
Job type
  • Full-time
Job description

Is this role right for you?

In this role you will:
  • Work closely with end users, and business teams to understand business needs, conduct gap analysis and requirements assessments as needed
  • Partner with Architecture on the design and integration
  • Deliver and enhance new and current solutions and applications
  • Be involved in the full life cycle of a project, responsible for the design, producing actionable and complete specifications, writing production quality code, and implementation
  • Design, deliver and implement data models, database schema and data pipelines
  • Design test sets and automate where possible, including functional and non functional testing, regression testing as well as performance testing
  • Write deployment scripts and leverage tools such as the Accelerator pipeline to promote code
  • Support the solution in production (as needed)
  • Improve the end user experience by finding scalable solutions and addressing complex ad hoc queries.
  • Effectively communicate with technical and non-technical audiences
  • Able to work with and refactor legacy code (as needed).
  • Coach and train end users (as needed).
  • Participate and run SCRUM Meetings (as needed).

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:

  • 4+ years’ experience with Python (PySpark, Pandas),
  • 4+ years’ experience with designing scalable ETL pipelines & data modeling
  • 4+ years’ experience developing, deploying, and maintaining large scale applications with complex integration
  • 4 + years’ experience reading, writing, and running SQL scripts.
  • Working experience with data technologies and databases, preferably in one or more of: Postgres, MSSQL, Oracle DB, Apache Spark, Apache Kafka, Apache ElasticSearch, comfortable working with large datasets
  • Working experience with data platforms: DataBricks or Snowflake
  • Working experience with cloud platforms (Azure/GCP)
  • Working experience with workflow orchestration tool such as Airflow or Data Factory
  • Working experience with Web Services & API
  • Hands-on experience with DevOps: CI/CD (Jenkins, Git)
  • Experience working in an Agile environment, with experience and understanding of Test-Driven Development methodology.
  • Bachelor’s degree in computer science, Engineering or relevant experience.

Preferred Qualifications (Nice to have)

  • Understanding of networking protocols and security principles
  • Capital Markets product knowledge
  • Dockers, Kubernetes experience
  • Experience working with real-time, high availability and low latency systems
  • Experience in multi-threaded applications

What's in it for you?

  • Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
  • Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove, and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
  • Community Engagement - no matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.

#LI-Hybrid

Create a job alert for this search

Lead Software Engineer (Python | Databricks) • Toronto, ON, CA

Similar jobs

Senior Python Software Engineer

Quantum Technology Recruiting Inc. (QTR)toronto, on, Canada
Permanent

Downtown Toronto, Hybrid/Onsite.We're partnering with a growing financial technology firm looking to add a Senior Backend Engineer to their engineering team in Toronto.This position focuses on buil... Show more

 • Promoted

Senior Python Engineer (Toronto)

Fitch GroupToronto, Ontario, Canada
Full-time

This job is with Fitch Group, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.Senior Softw... Show more

 • Promoted

Data Engineer

searchlabsmarkham, on, Canada
Full-time

This Data Engineer role is a one-year contract, working on a hybrid in-office/remote model in the GTA.The compensation range is $60-$100/hr.Build and maintain ETL pipelines for enterprise data inte... Show more

 • Promoted

Lead Python Developer

OpenTextrichmond hill, york region, Canada
Full-time

At OpenText, AI is at the heart of everything we do—powering innovation, transforming work, and empowering digital knowledge workers.We are hiring talent AI can't replace to help us shape the futur... Show more

 • Promoted

Software Engineer IV with Leadership Focus

ACV Auctionstoronto, on, Canada
Full-time

ACV is looking for a Software Engineer IV passionate about leading teams and solving complex engineering problems.Embrace a role that combines technical excellence with active mentorship.In this du... Show more

 • Promoted

Lead Full Stack Software Engineer Procurify

ProcurifyToronto, ON, CA
Full-time

Take the lead as a Full Stack Software Engineer at Procurify.Drive technical solutions and develop innovative software using Python/Django and TypeScript/React in a collaborative remote environment... Show more

 • Promoted

Lead Engineer (Python and Capital Markets)

CollaberaToronto
Full-time +1

Lead Engineer (Python and Capital Markets).This range is provided by Collabera.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message th... Show more

 • Promoted

Lead Software Engineer - C$160,000 - C$170,000 A Year

CPP InvestmentsToronto, Canada
Full-time

Title:Lead Software Engineer (Python and AWS)# of Openings:1Client:Investments IndustryLocation:Downtown, TorontoWork Model:4 day/week onsiteBonus:160-170k/annum + 25%OverviewCollabera is supportin... Show more

 • Promoted

Staff Software Engineer, Data Systems (Python) - $190,000 - $220,000 A Year

NorthbeamToronto County, Canada
Full-time

Data Systems Engineer focused on building scalable data pipelines and integrations for a marketing intelligence platform.Responsibilities include technical leadership, data ingestion, optimization,... Show more

 • Promoted

Lead Software Engineer (Python | Databricks)

ScotiabankToronto
Full-time

Lead Software Engineer (Python | Databricks).Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Global Banking and Markets Engineering (GBME) is t... Show more

 • Promoted

Senior Software Engineer in Python Development

VySystemsToronto, ON, CA
Full-time

Drive innovation as a Senior Software Engineer specializing in Python.Contribute to a scalable microservices banking platform while fostering a collaborative team environment.This role is perfect f... Show more

 • Promoted

Software Engineer, Python

AutoSyncGreater Toronto Area, ON, CA
Full-time

TRADER Corporation is a trusted Canadian leader in online media, dealer and lender services.AutoSync, and Dealertrack Canada.Quebec) offers the largest inventory of new and used cars in Canada, wit... Show more

 • Promoted

Senior Python Software Engineer - Toronto - $100,000 - $150,000 A Year

ValidusEast York, Canada
Full-time

Validus seeks a back-end financial software engineer for its growing tech team, focusing on designing, implementing, and maintaining systems for trade execution, portfolio management, and risk anal... Show more

 • Promoted

SoC Data Path Engineer

Advanced Micro Devicesmarkham, on, Canada
Full-time

At AMD, we believe technology can change lives for the better.It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us.And we’re looking for ta... Show more

 • Promoted

Data Engineer (Python and AWS)

Iris Software Inc.Toronto, ON, CA
Full-time

Data Engineer (Python and AWS).Toronto, ON (Hybrid, 3 days onsite).Hands‑on experience with AWS services (EC2, Lambda, S3, RDS, IAM, CloudWatch).Strong understanding of RESTful APIs and microservic... Show more

 • Promoted

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Canonicaltoronto, on, Canada
Full-time

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics.Python and Kubernetes Software Engineer - Data, AI/ML & Analytics.Python and Kubernetes Software Engineer - Data, AI/ML & Analytics... Show more

 • Promoted

Lead Python Platform Engineer

Insight Globaltoronto, on, Canada
Full-time +1

This range is provided by Insight Global.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Insight Global.Profe... Show more

 • Promoted

Senior Python Lead Engineer For Scalable Manufacturing Ops - C$95,000 - C$115,000 A Year

Longboard Architectural ProductsToronto County, Canada
Full-time

Lead a software engineering team in developing vital operational solutions, focusing on Python and ReactJS.Requires 5+ years of experience and leadership skills. Show more

 • Promoted

Senior Software Engineer, Python (Toronto)

Fitch Group, Inc., Fitch Ratings, Inc., Fitch Solutions GroupToronto, ON, CA
Full-time

Category: Information Technology.Senior Software Engineer, Python Programmer.Fitch Ratings is currently seeking a Senior Software Engineer specializing in Python Programming or applications to join... Show more

 • Promoted

Lead Software Engineer - DB2 developer

Tek Leaders IncToronto, ON, CA
Temporary

Data-Other DWH Database with Data Modelling, ETL.We are looking for an experienced.The role requires the candidate to understand the landscape of the application and the data, including its topolog... Show more