RFSO No. 000947- Data Engineer Level 2

Job Description

Our public sector client is seeking an experienced Data Engineer for a 2-month fully remote contract opportunity. This role requires expertise in building robust data pipelines using PySpark, Azure Data Factory, and Databricks within a Microsoft Azure environment.Security Requirement

• Mandatory: Government of Canada Reliability Status security clearance
• Candidates with clearances in process may be considered, but this could delay the start of the contract.

Key Responsibilities

• Design and implement data pipelines using PySpark, Azure Data Factory, and Databricks
• Work with Azure Data Lake Storage (ADLS) and integrate various Azure data services
• Collaborate with stakeholders to understand data requirements and transform business needs into technical solutions
• Development in cloud environments, primarily Microsoft Azure

Required Skills and Experience

• Strong hands-on experience with data engineering, focusing on pipeline development
• Proficiency in SQL, PySpark, ADLS, Databricks, and Azure Data Factory
• Solid understanding of relational SQL-based operational databases
• Experience with cloud development (preferably Microsoft Azure)