Search jobs > Toronto, ON > Etl developer

ETL Developer with strong experience in AWS Glue, Python and Py-Spark

Astra North Infoteck Inc.
Toronto, ON, ca
$92 an hour (estimated)
Full-time
Quick Apply

Job Description

Role Description :

Design and Development of Actuarial Data Feed enhancements using AWS Glue, Python and

Pyspark.

  • Unit testing and creation of related test artifacts as per Customer standards.
  • Provide support for Integration Testing and Defect fixing Support.
  • Participate in Requirement Analysis, Estimation, Solution & Design, and Development and Implementation of applications hosted on AWS
  • Contribute to defining timetables, project plans and product roadmaps
  • Enhancements and support to the Glue, Lambda, ETL jobs
  • Apply analysis skills to understand and assess the impact of infrastructure and technical changes within the environment
  • Provide recommendations and alternatives for system enhancements as applicable
  • Take complete ownership of work assignments and ensure the successful completion of assigned tasks
  • Establish and maintain relationships with Customer’s lead, business partners, subject matter experts and software vendors.
  • Create and maintain technical documentation for supported systems
  • Ensure Customer’s Information Security Policies and GCC are compiled to in any solution
  • Maintain effective communication with management, team members and the business
  • Major focus on designing, developing solutions based out of AWS Glue and related services

Essential Skills :

  • Bachelors’ degree in computer science or related fields.
  • Minimum 5+ years of overall experience working with complex technical environments and ETL Technologies.
  • 3+ years of experience in creating ETL jobs using AWS Glue, Python and Py-Spark
  • Experience in creating python scripts using data libraries.
  • Worked on Spark- PySpark or Scala.
  • Experience with Relational SQL (Oracle, Postgres, SQL Server) databases
  • Strong knowledge of SQL query language
  • Good understanding / Hands- on with AWS data services like Glue, Step function, Lambda, AWS Workflows, S3, Redshift, ODS.
  • Experience in working with AWS SDK and integration with various AWS services
  • Hands-on experience with DevOps tools (Git, Jenkins, SourceTree, Ansible, etc.)
  • Experience in any object-oriented / object function scripting - Python etc.
  • Experience with Powershell scripting
  • Experience with Windows / Unix scripting languages
  • Experience with SFTP and TCP network protocols
  • Experience with integrating vendor packages into an established production environment consisting on various technologies and platforms
  • Knowledge of Active Directory, Single Sign-On and Web Hosting concepts
  • Proficient with the ITIL framework and processes such as Change, Incident, Problem and Configuration Management

Desirable Skills :

  • Strong analytical and problem-solving skills with ability to analyze situations / problems systematically and deliver effective right-sized solutions in a timely manner
  • Experience with managing and coordinating team activities in a multi-site environment
  • Strong organizational and planning skills
  • Excellent verbal and written communications skills
  • Experience with Agile methodology
  • Relevant AWS certification
  • 25 days ago
Related jobs
C. G. Consulting Group Inc.
Mississauga, Ontario

Mainly use Talend with SQL, Java and Python (Banking Domain). We are looking for a talented and experienced Talend Developer to join our dynamic Data team. Hands on Experience with distributed caching technologies like Redis, Couchbase etc. Hands on Experience with BI Reporting platforms (Power BI/T...

S.i. Systems
Toronto, Ontario

Provides technical expertise with a focus on efficiency, reliability, scalability, and security; includes planning, evaluating, recommending, designing, operationalizing, and supporting solutions in compliance with enterprise and industry standards. We are looking for a highly skilled and experience...

ABL Employment
Mississauga, Ontario

We are looking for some great people to join our team! If you have experience working with warehouse inventory then this job is for you! This job site is transit accessible and offers a convenient day shift!. Ability to lift 50lbs and be standing / walking / bending / lifting for long periods of tim...

C. G. Consulting Group Inc.
Toronto, Ontario

The company invests in all major asset classes, including public equity, private equity, real estate, infrastructure and fixed-income instruments, and currently has offices in Toronto, UK, EU, USA, Asia and South America. Develop solutions that are in line with the client's technology biases, delive...

Algobrain
Toronto, Ontario

Join our team and look forward to: Diverse and inspiring colleagues and approachable leaders Stimulating work in a fast-paced, intellectually challenging environment Accelerated exposure and responsibility Global career development opportunities Being motivated every day by important social purpose ...

S.i. Systems
Toronto, Ontario

As part of our Software Engineering Group, you will be working with globally distributed teams, including business representatives, business analysts, architects, and engineers to plan, design, develop, test, and implement solutions. Configuration and coding using Guidewire tools and accelerators, G...

CanadianNanny.ca
Toronto, Ontario

Additionally, we hope to find someone who is willing to assist with light housekeeping tasks and meal preparation, running some errands and shopping allowing us to focus on spending quality time with our precious childrenIf you are reliable, organized, and have a genuine love for children, we encour...

S.i. Systems
Toronto, Ontario

Maintain an understanding of the latest technologies and programming best practices . Maintain and support existing web applications and implement new features. Coordinate and organize the resources to ensure punctual delivery of finalized projects within scope. Lead the team to ensure meeting the t...

Axelon Services Corporation
Mississauga, Ontario

This role will require extensive development using Java, Python, Microservices, Cloud Computing (AWS), Containerisation, OpenShift/Kubernetes, and Big Data technology. Work with business analyst and stakeholders to interpret business requirements and create system design based on requirements. Exper...

Housekeeper.com
Pickering, Ontario

Are you a dedicated and detail-oriented housekeeper looking for a rewarding part-time opportunity? We are a busy family of five seeking a reliable housekeeper to help keep our home running smoothly. Join us in making our home a more enjoyable place for our kids and furry friend!We can’t wait to meet...