Data Engineering Manager
Confidential
Greater Toronto Area, Canada
$95 an hour (estimated)
Full-time
The Toronto hub will serve as the base of our new Data / AI team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI.
This strategic investment is integral to for organization's vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin the organization's Next-Gen research enablement platform and data products.
This role demands exceptional leadership and technical prowess to drive the development of next-generation research enablement platforms and advanced data products leveraging AI / ML technologies.
- Provide technical leadership to implement a strategic data foundation roadmap on Azure Databricks, ranging from architectural design to data engineering to feature engineering
- Architect and implement production level data pipelines, including end-to-end pipeline load performance testing and optimization
- Resident technical expert in Lakehouse technology and delta lake, data governance, data ingestion and processing, data modeling and warehousing
- Lead proof of concept use cases, estimating workload sizing, and custom architectures
- Mentor and train junior data engineers
Minimum Qualifications :
- 5-10 years experience in a technical role with balanced expertise in both these areas : Data Engineering / Lakehouse - Data Applications Engineering
- Extensive experience with Azure Databricks for data engineering and ML pipelines
- Experience maintaining and extending production data systems to evolve with complex needs
- Experience scaling big data workloads that are performant and cost-effective
- Experience designing data solutions on cloud infrastructure and services, such as AWS, Azure, or GCP using best practices in cloud security, data privacy and data governance
- Production programming experience in SQL and Python or Scala
- Bachelor's or Master’s degree in Computer Science, Information Systems, Engineering
- Proven leadership skills, a strategic mindset, and a passion for driving innovation in Data Engineering and AI / ML technology
- Exceptional stakeholder management and communication skills to effectively communicate across global teams.
17 days ago