Responsibilities
- Participate in product teams to analyze systems requirements, architect, design, code and implement cloud-based data and analytics products that conform to standards
- Design, create, and maintain cloud-based data lake and lakehouse structures, automated data pipelines, analytics models
- Liaises with cluster IT colleagues to implement products, conduct reviews, resolve operational problems, and support business partners in effective use of cloud-based data and analytics products.
- Analyze complex technical issues, identify alternatives and recommend solutions.
- Support the migration of legacy data pipelines from Azure Synapse Analytics and Azure Data Factory (including stored procedures, views used by BI teams, and Parquet files in Azure Data Lake Storage (ADLS)) to modernized Databricks-based solutions leveraging Delta Lake and native orchestration capabilities
- Support the development of standards and a reusable framework that streamlines pipeline creation
- Participate in code reviews and prepare/conduct knowledge transfer to maintain code quality, promote team knowledge sharing, and enforce development standards across collaborative data projects.
General Skills
- Experience in multiple cloud-based data and analytics platforms and coding/programming/scripting tools to create, maintain, support and operate cloud-based data and analytics products, with a preference for Microsoft Azure
- Experience with designing, creating and maintaining cloud-based data lake and lakehouse structures, automated data pipelines, analytics models in real world implementations
- Strong background in building and orchestrating data pipelines using services like Azure Data Factory and Databricks
- Demonstrated ability to organize and manage data in a lakehouse following medallion architecture;
- Background with Databricks Unity Catalog for governance is a plus
- Proficient in using Python and SQL for data engineering and analytics development
- Familiar with CI/CD practices and tools for automating deployment of data solutions and managing code lifecycle
- Comfortable conducting and participating in peer code reviews in GitHub to ensure quality, consistency, and best practices
- Experience in assessing client information technology needs and objectives
- Experience in problem-solving to resolve complex, multi-component failures
- Experience in preparing knowledge transfer documentation and conducting knowledge transfer
- Experience working on an Agile team
Data Science Developer - Senior (ONSITE) JP210 • Fredericton, NB, Canada
Our client, a provider of application lifecycle management has an opportunity for an experienced pre‑sales application engineer to join their Sales & Service Team.You are a results‑oriented team pe... Show more
We're now accepting participants for focus group studies! You can earn up to $750 per week working part-time from home.Simply register to see if you qualify—no experience as an administrative assis... Show more
Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Business Intelligence Lead – Symbio (Government of New Brunswick).Location: Remote (Monthly travel to ... Show more
Take a pivotal role as a Senior Software Developer with Lastwall, focusing on Rust and secure software solutions for high-stakes environments.Engage in impactful projects supporting key sectors.At ... Show more
At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Fredericton, Canada | Posted on 02/05/2023. Show more
Are you passionate about making a difference in the world? Look no further! The Borgen Project is an international organization that works at the political level to improve living conditions for pe... Show more
A government healthcare project is seeking an experienced Business Intelligence Lead to champion the design and implementation of a comprehensive BI framework.This role requires over 10 years of ex... Show more
Explore a unique opportunity as an Intermediate Spatial Ecologist at WSP, specializing in geospatial analytics and AI integration in a hybrid work environment.Drive ecological advancements forward.... Show more
Since its launch 5 years ago, over 50MN users have earned and withdrawn over $150MN! The platform is rated 4.TrustPilot with over 230k+ reviews, establishing Freecash as one of the highest rated op... Show more
At Stantec, we have some of the world’s leading professionals passionate about enabling our business to be its best.Our business teams include finance, procurement, human resources, information tec... Show more
Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Show more
Senior Environmental Scientist or Engineer (Contaminated Sites) – Fredericton or Bedford.There's no pledge more important than the one we make to look after our environment, and we’re committed to ... Show more
Elevate your career as a Senior Exploration Geologist, focusing on high-potential gold and antimony projects.Drive exploration success in a region rich with resources.In this full-time role based i... Show more
Elevate your career with Teledyne CARIS in Fredericton as a Python Developer focused on cloud-native solutions for geospatial charting.Contribute to automating and enhancing critical services.Teled... Show more
Environmental Scientist - Site Investigation and Remediation.We are currently seeking an Intermediate Environmental Scientist/Engineer to join our Environmental Services team in New Brunswick.Your ... Show more
A public-sector technology firm is seeking an experienced Application Developer to work on the maintenance and enhancement of a critical enterprise application in Fredericton, NB.The ideal candidat... Show more
){kind=logo}
