Talent.com
Data Architect (Databricks)

Data Architect (Databricks)

Human ResourcesMarkham, York Region, Canada
11 days ago
Job type
  • Full-time
Job description

Miller Waste Systems Inc. has been in operation since 1961. Miller is a leader in waste management and diversion, providing governments and industries with a wide range of services in the province of Ontario, Nova Scotia, New Brunswick, and Manitoba. Miller has over 50 years’ experience in the waste management sector, and currently operates out of more than 30 locations. We are looking for a highly capable Data Architect to join our team, based in Markham, ON.

Summary :

The Data Architect will lead the design, governance, and strategy of the company’s data systems, encompassing the data warehouse, data lake, and integrations between systems. This role ensures the scalability, security, and performance of the data ecosystem, aligning it with business objectives. The ideal candidate combines technical expertise with strategic vision, leveraging tools like Databricks and Azure to build a robust and future-proof architecture.

Responsibilities :

  • Architecture Design & Strategy

Design and oversee the architecture of the company’s data warehouse and lakehouse using Databricks and Azure services.

  • Develop and maintain best practices for data modeling, storage, and system integration.
  • Define the roadmap for enhancing the data ecosystem, focusing on scalability, innovation, and business alignment.
  • Strategic Oversight

    • Act as a key advisor to business and IT leaders, ensuring data systems support organizational goals.

  • Lead initiatives to integrate emerging technologies (e.g., MLflow, Unity Catalog) into the company’s data strategy.
  • Ensure compliance with data governance, security, and privacy regulations.
  • Provide guidance on the design and optimization of ETL / ELT pipelines using Databricks, Delta Live Tables, and Azure Data Factory.
  • Collaborate with SMEs and analytics teams to streamline data ingestion and enhance reliability.
  • Supervise the integration of data from structured, semi-structured, and unstructured sources.
  • Performance & Cost Optimization

    • Oversee resource utilization and performance tuning of Databricks clusters and Spark jobs.

  • Implement strategies to reduce cloud costs while maintaining high performance and scalability.
  • Mentor and guide data engineers, analysts, and developers to implement architectural standards.
  • Foster collaboration between cross-functional teams to align data solutions with business needs.
  • Drive organization-wide adoption of data management best practices.
  • Security, Compliance, & Governance

    • Establish and enforce data security frameworks, including RBAC, encryption, and secure key management.

  • Collaborate with IT and compliance teams to maintain audit readiness and adhere to industry standards.

    • Qualifications & Requirements :

  • Advanced experience with Databricks features, such as Unity Catalog, MLflow, and Delta files.
  • Familiarity with Apache Spark internals and advanced libraries.
  • Knowledge of BI tools and platforms (e.g., Sage, Solver, Trux, DayForce, Dossier).
  • Understanding of financial data and reporting requirements.

    • Flexibility is required as this position occasionally requires travel, early starts, late finishes, and on rare occasions weekend work. This is an in-office role, but occasional remote work is acceptable when approved.

    Miller Waste Systems is committed to equity, diversity and inclusivity in the workplace, and we welcome applications from women, racially visible individuals, people with disabilities, indigenous peoples, and LGBTQ2S+ persons.

    J-18808-Ljbffr