Job Description
AWS Data Engineer – Data Warehouse & Netezza Migration
Location: Toronto; Hybrid 2 days a week in office
Must-Have Skills
· Amazon S3 (Data Lake)
· AWS Glue (ETL)
· AWS Lambda
· Amazon Redshift
· AWS Step Functions
· AWS IAM & CloudWatch
· IBM Netezza
Role and Responsibilities
· Required to have strong data warehouse technical knowledge.
· Must have knowledge in Bank and financial domain (Minimum 5+ years of experience).
· Design, develop, and maintain scalable data pipelines and workflows on AWS Build and manage data lakes and data warehouses (e.g., S3, Redshift).
· Develop ETL/ELT processes using tools like AWS Glue, Lambda, or Spark Strong solution.
· Knowledge in AWS Cloud and hands on experience with ETL process (like Kafka message processing, batch interface data injection and other business layer process).
· Optimize data ingestion, transformation, and loading processes.
· Work with stakeholders to understand and deliver data requirements.
· Ensure data quality, governance, and security compliance.
· Monitor and troubleshoot data pipelines and workflows Automate deployments using CI/CD pipelines Improve performance, cost optimization, and scalability.
· Coordinate with clients, data users and key stakeholders to understand feature requirements needed merge them to create reusable design patterns.
· Data onboarding using the developed frameworks Understand and make sense of available code in Netezza to design a best way to implement its current features in AWS Data Lake.
· Unit test code and aid with QA/SIT/Perf testing Migration to production environment
Good to have
· AWS Certifications (Solutions Architect / Data Analytics)
· Experience with Airflow (or Managed Workflows for Apache Airflow - MWAA)
· Exposure to Snowflake, Databricks, or Delta Lake
Requirements
Top 3 Required Skills: 1. IBM Financial transaction 2. Payment flow 3. Support Modernization Detailed Job Description: • Design, develop, and maintain applications built on IBM Financial Transaction Manager (FTM) to support core payments processing. • Contribute to the development of payment flows supporting transaction processing. • Build and support integrations between FTM and upstream/downstream systems using enterprise integration patterns. • Participate in the design, development, testing, deployment, and production support. • Troubleshoot and resolve application and integration issues in a complex, regulated environment. • Collaborate with architecture, QA, and operations teams to ensure platform stability, scalability, and performance. • Support modernization initiatives and enhancements to existing payment hub capabilities. • Produce clear technical documentation and participate in code reviews and knowledge sharing.