Our client is seeking a Senior Data Engineer to design and develop Azure data pipelines in an enterprise environment.
This is a hybrid position requiring onsite work up to 3 days a week in Calgary
Must Have :
- 6+ years as a Data Engineer with experience creating ETL pipelines from scratch
- 5+ years designing and integrating data within cloud environments, leveraging tools like Azure Data Factory pipelines and Azure Data Lake Storage.
- Knowledge of Oracle, Salesforce and / or Maximo
Nice to Haves :
Data Vault Methodology
Responsibilities :
- Design, develop, and maintain robust, scalable, and secure data pipelines to efficiently process large volumes of data for Azure and other cloud based platforms.
- Collaborate closely with cross-functional teams to identify data requirements and implement solutions that facilitate seamless access to data across the organization.
- Lead the orchestration layer for intricate data transformations, employing the data vault methodology to refine raw data into valuable assets for consumption, ensuring governance and data integrity.
- Establish and enforce processes and systems for monitoring data quality, guaranteeing the accuracy and availability of production data for key stakeholders and business processes.
- Cultivate expertise in business domains to effectively support the data needs of product teams, analytics, data scientists, and other stakeholders.
- Develop and maintain comprehensive documentation for data pipelines and essential metrics, ensuring accessibility and usability for all stakeholders.
17 days ago