SR Data Integration Developer (Data Engineer) with SQL, Python and Azure experience to support the Data management team.

S.i. SystemsEdmonton

Il y a 24 jours

Description de poste

Our client is seeking a SR Data Integration Developer (Data Engineer) with SQL, Python and Azure experience to support the Data management team.

We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will bring a strong technical background in data engineering, effective problem-solving skills, and the ability to collaborate across multiple teams. This role focuses on building, optimizing, and maintaining scalable data pipelines to support data-driven decision-making across the organization.

Onsite Calgary or Edmonton 3x a week is mandatory

Responsibilities :

Design, develop, and implement highly scalable, repeatable, and secure data pipelines and transformation processes
Collaborate with data scientists, analysts, and stakeholders to understand data needs and translate requirements into technical solutions
Optimize and maintain data architectures, including databases, data lakes, and data warehouses
Ensure data quality and consistency through rigorous testing and validation processes
Implement data governance and security protocols to protect data integrity and confidentiality
Monitor and troubleshoot data pipelines to ensure reliability and accuracy of data flows
Work with cloud platforms (e.g., Azure) to leverage scalable and cost-effective data storage and processing solutions
Document data processes and data models, ensuring they are accessible and understandable for both technical and non-technical stakeholders
Stay current with industry trends and emerging technologies to improve data engineering practices continuously

Must-Haves :

7+ years of experience in a Data Engineering role, with building and maintaining data pipelines and architectures

Proficiency in SQL, Python, and ETL tools

Experience with cloud platforms such as Azure (Data Factory, Databricks)

Data modeling , data warehousing , and data lake architectures

Utilities experience

Data governance principles, data privacy regulations, and security best practices

Nice-to-Haves :

Bachelor’s degree in Computer Science, Engineering, or a related field (Master’s preferred)

Passion for turning disparate data streams into organized, actionable analytics

Strong programming acumen, competency in manipulating large data volumes, and solid knowledge of a wide range of data processing and modeling technologies