Data Engineer

Job Title : Data Engineer (Python pyspark SQL Snowflake Data Factory Data Lakes OpenShift)

Location : Mississauga, ON

Job Summary :

We are seeking an experienced Data Engineer to design, develop, and maintain scalable data solutions. The ideal candidate will have a strong background in Python, PySpark, SQL, Snowflake, Data Factory, Data Lakes, and OpenShift, with a passion for building reliable data pipelines and enabling data-driven decision-making.

Key Responsibilities :

• Develop, construct, test, and maintain scalable data pipelines and ETL / ELT workflows using Python, PySpark, and SQL.
• Manage and optimize data storage solutions in Snowflake and on Data Lakes.
• Integrate data from multiple sources and ensure data quality, integrity, and security.
• Design and implement automated workflows using Azure Data Factory or other orchestration tools.
• Deploy and manage containerized applications and services on OpenShift.
• Collaborate with Data Scientists, Analysts, and Stakeholders to understand data requirements.
• Monitor and troubleshoot data pipelines and resolve performance bottlenecks.
• Maintain documentation of data architecture, workflows, and best practices.
• Ensure compliance with data governance and security policies.

Qualifications & Skills :

Preferred Skills :