Talent.com
Kumaran Systems
Azure DeveloperKumaran Systems • Toronto, Ontario, Canada
Azure Developer

Azure Developer

Kumaran Systems • Toronto, Ontario, Canada
29 days ago
Job type
  • Full-time
Job description

We are seeking an experienced Databricks developer withstrong expertise in Azure Databricks, Apache Spark, and modern data engineering practices. The ideal candidate will be responsible for designing, developing, and optimising scalable data pipelines, data lakehouse solutions, and cloud-based data platforms. The role requires hands-on experience with Spark processing, Delta Lake, Unity Catalogue, data modelling, and enterprise-grade data integration solutions.

Key Responsibilities

Data Engineering & Databricks Development

  • Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Apache Spark, and SQL.
  • Build and optimize batch and streaming data pipelines using PySpark, Spark Structured Streaming, and Auto Loader.
  • Develop and support enterprise data lakehouse solutions using Delta Lake and Databricks technologies.
  • Implement data ingestion, transformation, cleansing, and aggregation processes for large-scale datasets.
  • Develop reusable frameworks and best practices for data engineering solutions.

Data Modeling & Performance Optimization

  • Design and implement data models to support reporting, analytics, and business requirements.
  • Build and maintain Slowly Changing Dimensions (SCD Type 1 & Type 2) for data warehousing solutions.
  • Develop and optimize Change Data Capture (CDC) pipelines.
  • Optimize Spark workloads through partitioning, clustering, caching, and performance tuning techniques.
  • Ensure efficient query performance and scalability across large datasets.

Unity Catalog & Data Governance

  • Configure and manage Databricks Unity Catalog environments.
  • Create and manage catalogs, schemas, tables, materialized views, functions, and volumes.
  • Implement enterprise data governance, security, access control, and compliance standards.
  • Support metadata management and data lineage initiatives across the data platform.

Cloud & Integration

  • Develop cloud-native data solutions on Microsoft Azure and related cloud services.
  • Integrate data from multiple internal and external data sources.
  • Implement Lakehouse Federation and foreign catalogs to access external data platforms.
  • Collaborate with architects and stakeholders to design scalable cloud data solutions.

DevOps & Operational Excellence

  • Support CI/CD implementation and automated deployment processes.
  • Participate in code reviews, testing, and release activities.
  • Monitor and troubleshoot data pipeline failures and performance issues.
  • Ensure adherence to development standards, security policies, and operational best practices.

Required Qualifications

  • Strong hands-on experience with Databricks and Apache Spark (PySpark and/or Scala).
  • Extensive experience with SQL and complex data transformation techniques.
  • Experience in ETL/ELT development and enterprise data pipeline implementation.
  • Strong experience with Microsoft Azure and cloud-based data platforms.
  • Hands-on experience with Azure Databricks and Delta Lake.
  • Experience building batch processing pipelines using Auto Loader and real-time pipelines using Spark Structured Streaming.
  • Strong understanding of data warehousing concepts and dimensional modeling.
  • Experience implementing SCD Type 1, SCD Type 2, and CDC processes.
  • Strong knowledge of Spark performance tuning, partitioning, and optimization techniques.
  • Experience with CI/CD pipelines and DevOps practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
Create a job alert for this search

Azure Developer • Toronto, Ontario, Canada

Similar jobs

Azure Developer

MM ManagementToronto, ON, CA
Full-time

Strong hands on experience on programming knowledge in Java (must have).Experience in working with REST API and integrating other on-prem application with Azure cloud via REST API.Using function ap... Show more

 • Promoted

Redwood Software Cloud Infrastructure Developer

Redwood Softwaremarkham, on, Canada
Full-time

Join Redwood Software as a Cloud Infrastructure Developer, where you will architect and enhance innovative SaaS solutions on AWS.This role is pivotal in enabling customers through automated cloud o... Show more

 • Promoted

Azure Cloud Architect for Infrastructure Solutions

Tech Talent Internationaltoronto, on, Canada
Full-time

Lead cutting-edge Azure implementations as a Solution Architect.Drive the design of landing zones while optimizing VMware environments for diverse enterprise applications.This role focuses on creat... Show more

 • Promoted

Robinhood Senior Developer for Kubernetes

Robinhoodtoronto, on, Canada
Full-time

Take the lead as a Senior Developer for Kubernetes at Robinhood in Toronto, where you'll contribute to transformative financial technology.Your work will focus on scalable container infrastructure ... Show more

 • Promoted

Senior C/C++ Developer Data Pipelines

Israelvcforummarkham, on, Canada
Full-time

Drive innovation as a Senior C/C++ Developer for data pipelines at General Motors.This hybrid role emphasizes building and optimizing advanced embedded data infrastructures.This position requires o... Show more

 • Promoted

BrokerLink Azure Senior Developer Opening

Brokerlink Inc.Toronto, ON, CA
Full-time

Drive cloud innovation as a Senior Developer at BrokerLink, focusing on Azure applications and integrations.Enhance your professional growth within a values-driven team environment.BrokerLink invit... Show more

 • Promoted

Azure DevOps Engineer

Swoonmarkham, york region, Canada
Full-time

This range is provided by Swoon.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Swoon.Technical Recruiter @ S... Show more

 • Promoted

Specialized Developer for Scalability on Azure

BDO CanadaMarkham, York Region, CA
Full-time

Become a Specialized Developer focusing on building scalable applications on the Azure platform.Lead initiatives in system performance and secure cloud practices.This key role encompasses the devel... Show more

 • Promoted

Azure SRE Developer

Aarorn Technologies IncToronto
Full-time

Location: Toronto, ON (Hybrid - 4x Onsite a Week).Employment Type: Contract Opportunity.Interview Type: Face 2 Face (Onsite Interview Only).Aarorn Technologies Inc provided pay range).Monitoring an... Show more

 • Promoted

Azure Developer - C$112,400 - C$162,400 A Year

PwCEast York, Canada
Full-time

Develops, deploys, and optimizes applications on Microsoft Azure using cloud-native solutions.Architects Python microservices, manages databases, and ensures security and reliability. Show more

 • Promoted

Senior Developer with Azure Expertise, Hybrid

Direct IT Recruiting Inc.Toronto, ON, CA
Full-time

Drive innovation as a Senior Developer with a focus on investments in a hybrid role based in Toronto.Harness your extensive experience in Azure, C#, and Python to create impactful software solution... Show more

 • Promoted

Duckcreek Developer

CapgeminiToronto, ON, CA
Full-time

IT experience; with 5+ years in Duck creek.Must be expert in Duck creek Policy, Billing and should have knowledge on Data Insights, Claims, Message Hub.Prefer someone who has worked on Duck Creek O... Show more

 • Promoted

Azure Developer

Apex SystemsToronto, Canada
Full-time

Direct message the job poster from Apex Systems Senior Professional Technical Recruiter at Apex Systems Apex Systems is a global IT services provider and our consulting practice has an opening for ... Show more

 • Promoted

Cloud Developer

SPECTRAFORCEtoronto, on, Canada
Full-time

Job Title: Cloud Engineer – Azure or AWS.Location: Toronto, ON (once or twice a month onsite).Duration: 6+ Months (Possible Extension).Client is seeking an experienced Cloud Engineer (Azure/AWS) to... Show more

 • Promoted

Guidewire PolicyCenter Cloud Developer

United States Digital Space LLCmarkham, on, Canada
Full-time

Job Title: Senior Specialist - Package Implementation.Hybrid – Onsite: 3 days Work from Office – 2 days mandatory Tuesday & Wednesday, 1 day flexible any day from Monday, Thursday, or Friday.Guidew... Show more

 • Promoted

Sr. Guidewire Lead developer

Coforgemarkham, on, Canada
Full-time

Guidewire cloud, policy, Billing, Integration.Guidewire Lead developer with following skillset.Commercial Insurance Expertise.Extensive experience in underwriting, policy lifecycle, rating, endorse... Show more

 • Promoted

Senior API Developer - Azure Focus

Healthcare of Ontario Pension Plan Trust Fund Companytoronto, on, Canada
Full-time

Make an impact as a Senior API Integration Engineer on the Pension Application Development Team, dedicated to enhancing our Digital Insight Services Platform.Leverage your skills in a people-focuse... Show more

 • Promoted

Senior Azure & Power Platform Developer - Hybrid

Rubicon PathToronto, ON, CA
Full-time

A leading technology consultancy in Toronto seeks a Senior Software Developer to participate in software delivery for Azure cloud solutions.You will engage in development, support, and troubleshoot... Show more

 • Promoted

Senior Developer of Azure & Databricks

ScotiabankToronto
Full-time

Drive innovation at Scotiabank as a Senior Developer specializing in Azure and Databricks platforms in Toronto, Ontario.This role offers the opportunity to lead infrastructure management and enhanc... Show more

 • Promoted

Senior Developer Of Azure & Databricks

ScotiabankToronto, Canada
Full-time

Drive innovation at Scotiabank as a Senior Developer specializing in Azure and Databricks platforms in Toronto, Ontario.This role offers the opportunity to lead infrastructure management and enhanc... Show more