Software Developer - ETL - Senior

Job Title: Software Developer ETL Senior
Duration: 250 Business Days
Location: Toronto, ON (Onsite)
Role Overview
The Senior Software Developer ETL will be responsible for designing, developing, and supporting scalable enterprise data integration solutions within a centralized data repository. The role focuses on building and optimizing modern ELT/ETL pipelines using Azure and Databricks technologies, ensuring high data quality, performance, governance, and reliability. The resource will work closely with technical and business stakeholders in a public-sector healthcare environment.

Key Responsibilities

• Design and implement technical solutions for data acquisition, ingestion, transformation, and storage within a centralized data lakehouse environment.
• Develop, test, and maintain complex ELT/ETL pipelines using Azure Data Factory, Databricks (PySpark, SQL, Delta Live Tables), and dbt.
• Perform database and dimensional modeling to support star and snowflake schemas and optimize query performance.
• Conduct unit testing, data validation, and reconciliation to ensure data accuracy, completeness, and consistency.
• Produce and maintain technical design artifacts, system documentation, and support materials in accordance with public sector standards.
• Investigate and resolve incidents by analyzing data loads, transformations, and source data issues.
• Execute routine and ad-hoc data loads and fulfill service requests as required.
• Implement and report on data quality checks, lineage, metadata management, and governance controls.
• Collaborate with cross-functional teams to support analytics, reporting, and Power BI integration initiatives.

Experience and Skill Set Requirements
Technical Skills (50 Points)

• 10+ years of experience designing and developing scalable Medallion Data Lakehouse architectures.
• Extensive hands-on experience with Azure Databricks, Delta Lake, and distributed data processing frameworks.
• Strong expertise in data ingestion, transformation, and curation using ADF, PySpark, SQL, Delta Live Tables, and dbt.
• Experience integrating structured and unstructured data into enterprise analytical models.
• Advanced knowledge of relational and dimensional data modeling (SQL Server, Synapse, PostgreSQL).
• Proven expertise in SQL optimization, indexing, partitioning, and performance tuning.
• Hands-on experience with ADLS, Azure Synapse Analytics, Azure SQL, Event Hubs, Azure Functions, and cloud orchestration.
• Proficiency in Python (PySpark), SQL, and PowerShell for data engineering automation.
• Experience implementing CI/CD pipelines using Azure DevOps or GitHub Actions.
• Strong understanding of cloud security, RBAC, data governance, Unity Catalog, data lineage, and metadata management.
• Experience working with Parquet, ORC, JSON formats.
• Expertise in Power BI, including DAX, data modeling, performance tuning, and integration with Azure Synapse and Databricks SQL Warehouses.
• Familiarity with MLflow, AutoML, and embedding AI-driven insights into data pipelines.

Core Skills and Experience (30 Points)

• 10+ years of experience translating technical system specifications into tested, production-ready applications.
• Extensive experience in technical analysis, program design, coding, unit testing, and documentation for mission-critical systems.
• Strong background across multiple platforms, operating systems, databases, middleware, and integration technologies.
• Proven experience developing and maintaining system design models and technical specifications.
• 5+ years of experience evaluating technical design options, conducting gap analysis, and assessing integration capabilities.
• Full SDLC end-to-end experience, including requirements, design, development, testing, deployment, and support.

General Skills (15 Points)

• Demonstrated technical leadership with the ability to guide teams and recommend continuous improvements.
• Exceptional analytical, problem-solving, and decision-making skills.
• Strong interpersonal, communication, facilitation, and stakeholder engagement skills.
• Proven troubleshooting and critical-thinking abilities.
• Strong consulting, negotiation, and relationship-building skills.
• Excellent customer service orientation with tact and diplomacy.
• Highly organized, detail-oriented, adaptable, and able to meet strict deadlines in a fast-paced environment.

Public Sector / Healthcare Experience (5 Points)

• Knowledge of Public Sector Enterprise Architecture artifacts, standards, and documentation practices.
• Familiarity with PMI and public sector I&IT project management methodologies.
• Understanding of Ministry policies, IT approval processes, and governance requirements.
• Experience working on large, complex healthcare or public sector IT initiatives.