Senior Python ETL developer

Job Description

Do you want to build and maintain mission critical data processing and transformation systems that will help run one of Canada’s biggest financial institutions?

Do you enjoy being part of a tight-knit, empowered team? Do you have experience writing data manipulation code in a cloud using Python and / or Pyspark?

If so, we’d like to hear from you!

We are looking for an Extract, Transform, and Load (ETL) Developer with a strong technical background and cloud experience to join the Corporate Application Solutions (CAS) team.

This is an exciting opportunity to be part of the IT organization dedicated to excellent customer service through digital transformation, supporting continuous learning, career growth and diversity.

What will you do?

• Provide ongoing support and maintenance of AWS Glue ETL and related integration components, including on-call support on a rotation basis, problem analysis, resolution, and escalation.
• Participate in Requirement Analysis, Estimation, Solution & Design, and Development and Implementation of applications hosted on AWS.
• Contribute to defining timetables, project plans and product roadmaps.
• Configure and install software products, patches, vendor releases in multiple environments.
• Enhance and support the Glue, Lambda, and ETL jobs.
• Apply analysis skills to understand and assess the impact of infrastructure and technical changes within the environment.
• Provide recommendations and alternatives for system enhancements.
• Take complete ownership of work assignments and ensure the successful completion of assigned tasks.
• Establish and maintain relationships with overseas and 3rd party team members, business partners, subject matter experts and software vendors.
• Create and maintain technical documentation for supported systems.
• Ensure Sun Life Information Security Policies and GCC are adhered to in any solution.
• Maintain effective communication with management, team members and the business.

What you need to succeed :

• Bachelor’s degree in computer science, computer engineering, or equivalent experience.
• 5+ years of experience working with complex technical environments involving multiple IT platforms. We use Windows, Unix, Linux, Cloud, and ETL technologies.
• 3+ years of experience creating ETL jobs using cloud technologies (e.g., Glue, Data Bricks).
• Experience in creating Python scripts using data libraries.
• Skill with Spark, PySpark, or Scala.
• Experience with Relational SQL (Oracle, PostgreSQL, SQL Server) databases.
• Strong knowledge of SQL query language able to perform all CRUD operations.
• Experience in any object-oriented / object function scripting language, such as Python.
• Experience with Windows / Linux / Unix scripting languages.
• Proficient with the ITIL framework and processes such as Change, Incident, Problem and Configuration Management.

Preferred Skills :

• Experience with SFTP and TCP network protocols.
• Experience with integrating vendor packages into an established Production environment consisting of various technologies and platforms.
• Knowledge of Active Directory, Single Sign-On and Web Hosting concepts.
• Good understanding / hands-on experience with AWS data services - like Glue, Step function, Lambda, AWS Workflows, S3, Redshift, ODS.
• Experience in working with AWS SDK and integration with various AWS services.
• Hands-on experience with DevOps tools (e.g., Git, Jenkins, SourceTree, Ansible).
• Strong analytical and problem-solving skills with ability to analyze situations / problems systematically and deliver effective right-sized solutions in a timely manner.
• Strong organizational and planning skills.
• Excellent verbal and written communications skills.
• Experience with managing and coordinating team activities in a multi-site environment.

Nice to have :

• Experience with ETL development tools (PowerCenter, Informatica and / or SSIS).
• Experience with PowerShell scripting.
• Experience with Job schedulers (Control-M).
• Experience with Tableau reporting system.
• Experience with PostgreSQL.

Notes / Unique requirements :

• Occasional weekend and after-hours work.
• On-call support as part of a rotation.
• Occasional travel between Sun Life locations may be required depending on work assignments.
• Must be able to obtain Reliability Status through the Government of Canada before a start date can be confirmed (includes a background check with fingerprinting by the RCMP).
Il y a plus de 30 jours