MUST HAVES
Must Haves:
Location: 3 days onsite
Responsibilities
- Participate in product teams to analyze systems requirements, architect, design, code and implement cloud-based data and analytics products that conform to standards
- Design, create, and maintain cloud-based data lake and lakehouse structures, automated data pipelines, analytics models
- Liaises with cluster IT colleagues to implement products, conduct reviews, resolve operational problems, and support business partners in effective use of cloud-based data and analytics products.
- Analyze complex technical issues, identify alternatives and recommend solutions.
- Support the migration of legacy data pipelines from Azure Synapse Analytics and Azure Data Factory (including stored procedures, views used by BI teams, and Parquet files in Azure Data Lake Storage (ADLS)) to modernized Databricks-based solutions leveraging Delta Lake and native orchestration capabilities
- Support the development of standards and a reusable framework that streamlines pipeline creation
- Participate in code reviews and prepare/conduct knowledge transfer to maintain code quality, promote team knowledge sharing, and enforce development standards across collaborative data projects.
General Skills
- Experience in multiple cloud-based data and analytics platforms and coding/programming/scripting tools to create, maintain, support and operate cloud-based data and analytics products, with a preference for Microsoft Azure
- Experience with designing, creating and maintaining cloud-based data lake and lakehouse structures, automated data pipelines, analytics models in real world implementations
- Strong background in building and orchestrating data pipelines using services like Azure Data Factory and Databricks
- Demonstrated ability to organize and manage data in a lakehouse following medallion architecture;
- Background with Databricks Unity Catalog for governance is a plus
- Proficient in using Python and SQL for data engineering and analytics development
- Familiar with CI/CD practices and tools for automating deployment of data solutions and managing code lifecycle
- Comfortable conducting and participating in peer code reviews in GitHub to ensure quality, consistency, and best practices
- Experience in assessing client information technology needs and objectives
- Experience in problem-solving to resolve complex, multi-component failures
- Experience in preparing knowledge transfer documentation and conducting knowledge transfer
- Experience working on an Agile team
Desirable Skills
- Written and oral communication skills to participate in team meetings, write/edit systems documentation, prepare and present written reports on findings/alternate solutions, develop guidelines / best practices
- Interpersonal skills to explain and discuss advantages and disadvantages of various approaches
Technology Stack
- Azure Storage, Azure Data Lake, Azure Databricks Lakehouse, Azure Synapse, Azure Databricks
- Python, SQL
- Power BI
- GitHub
Data Science Developer - Senio • Toronto, ON, Canada
We are looking for a Data Science Lead who will:.Partner closely with our clients' executive and technical teams to guide their decisions relating to AI, analytics, data engineering and data in gen... Show more
The Senior Data Scientist will be a key member of the data analytics team.In this role, you will use your expertise to solve data related challenges in manufacturing operations and vehicle data ana... Show more
Direct message the job poster from Compunnel Inc.Deep expertise in relational databases (Snowflake, PostgreSQL, Amazon Aurora), big data platforms (Hadoop), and NoSQL databases (MongoDB).Advanced p... Show more
This Data Engineer role is a one-year contract, working on a hybrid in-office/remote model in the GTA.The compensation range is $60-$100/hr.Build and maintain ETL pipelines for enterprise data inte... Show more
Boston, Chicago, New York, Dallas, Toronto, Montreal.Oliver Wyman is a global leader in management consulting.With offices in 50+ cities across 30 countries, Oliver Wyman combines deep industry kno... Show more
At Lyft, our mission is to improve people’s lives with the world’s best transportation.To do this, we start with our own community by creating an open, inclusive, and diverse organization.Our trans... Show more
Our Data Scientists are a highly motivated and curious group.They're spearheading Achievers' efforts to build products powered by AI and enjoy solving all the problems that come with building at sc... Show more
At IBM, work is more than a job – it’s a calling: To build.To think along with clients and sell.Not just to do something better, but to attempt things you’ve never thought possible.Are you ready to... Show more
At Stantec, we have some of the world’s leading professionals passionate about enabling our business to be its best.Our business teams include finance, procurement, human resources, information tec... Show more
Drive Strategic Insights: Apply strategic, operational and analytics standard processes to secure agreement from multiple partners for long-term solutions, and influence leaders across the Trust or... Show more
Data Scientist or Decision Scientist.Hybrid / Corporate Office in Richmond Hill, Ontario.X% discretionary incentive target*.Technology is in the DNA of its founders.The Chairman and Co-Founder hold... Show more
Shape the future of automotive technology with TRADER as a Senior Data Scientist based in Toronto.Apply your advanced skills in machine learning to build and maintain systems that drive the busines... Show more
Wealthsimple is Canada’s leading financial innovator.The company offers a full suite of simple, sophisticated financial products across managed investing, do‑it‑yourself trading, cryptocurrency, ta... Show more
Aviva Canada values care, commitment, community, and confidence.We put people first—our employees, our customers, and our communities—while protecting what matters most through a culture of inclusi... Show more
A leading information management company is seeking a Senior Site Reliability Engineer to ensure the reliability of their customer-facing SaaS platforms.You will work on distributed systems using t... Show more
Our employees are at the heart of everything we do.Together, we help people, businesses, and society prosper in good times and be resilient in bad times.Our employee promise represents Intact’s com... Show more
Katalyze AI is a fast-growing AI-driven biotech platform company on a mission to make life-saving drugs accessible and affordable for everyone.Our AI Agents help pharmaceutical and biotech companie... Show more
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert:.Ofc of Vice Pres, Research & Innovation.The Vice-President, Research & Innovation (VPRI) portfolio supports... Show more
