Job Description
Role: AWS Big Data Platform Engineer (Netezza to AWS Migration)
Hybrid: 2 days a week in office
Job Summary: We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing. This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment.
Key Responsibilities
· Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies.
· Lead and support data platform migration initiatives (On-Prem to AWS Cloud), ideally with Netezza background.
· Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar.
· Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow.
· Build and optimize data workflows and orchestration pipelines using Airflow.
· Work with real-time streaming technologies such as Kafka and Spark Streaming.
· Perform data ingestion, transformation, and validation from multiple data sources.
· Optimize SQL queries for performance and scalability.
· Monitor system performance, troubleshoot issues, and ensure system reliability.
· Collaborate with cross-functional teams including developers, architects, and infrastructure teams.
Required Technical Skills
· Cloud Technologies
· Strong experience in AWS Cloud services:
· EMR, EC2, S3, VPC, RDS, Redshift
· AWS Glue, IAM, CloudWatch, CloudFormation
· Airflow (or AWS Managed Workflows)
· Databases
Experience working with:
· Netezza is mandatory
· SQL-based systems: SQL Server and PostgreSQL
· Data warehouses: Teradata, Redshift, Netezza
· ETL Tools
Hands-on experience with:
· SSIS
· Programming & Scripting
Strong proficiency in:
· SQL
· Shell scripting
Good to have:
· Python
· Operating Systems
· Strong experience in Unix/Linux environments
Key Qualifications
· 10+ years of experience in Data Engineering / Big Data / Platform Engineering.
· Hands-on experience in AWS and Hadoop ecosystems.
· Experience in data migration projects (e.g., Hadoop to AWS, DB migrations).
· Strong understanding of data warehousing concepts and ETL design patterns.
· Expertise in query optimization and performance tuning.
· Experience supporting production data platforms.
· Bachelor’s degree in Computer Science, Engineering, or related field.
Preferred Qualifications
· Experience in Banking / Financial Services domain
· Experience with data lake architecture and governance
· Knowledge of DevOps tools and CI/CD pipelines
· Experience in platform engineering and framework development
Soft Skills
· Excellent problem-solving and analytical skills
· Strong communication and collaboration abilities
· Ability to work independently and lead initiatives
· Experience mentoring team members
Nice-to-Have
· Experience with tools like Ansible, Git, JIRA
· Exposure to NoSQL databases (HBase, MongoDB)
· Experience in data masking and security frame
AWS Big Data Platform Engineer (Netezza to AWS Migration) • Toronto, ON, ca
Individually we are people, but together we are Aviva.Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.At Aviva Canada, we put peopl... Show more
A leading risk management firm in Toronto is seeking a Platform Engineer to enhance their AWS infrastructure and support CI/CD pipelines.The ideal candidate will have at least 1 year of experience ... Show more
A leading IT consulting firm in Toronto is seeking a Data Engineer to enhance trading operations through cloud-based solutions.You will design, build, and maintain a scalable data platform, ensurin... Show more
Venture outside the ordinary - TMX Careers The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations ... Show more
A data management firm located in Ontario is looking for a Data Engineer to support retail and e-commerce data initiatives.This position involves designing and maintaining scalable data pipelines, ... Show more
A fast-growing analytics consulting firm is seeking a Data Engineer to architect and implement advanced analytics capabilities.The role requires expertise in data engineering with extensive experie... Show more
A leading fintech startup in Toronto is seeking a Senior Software Engineer to drive projects from implementation to deployment.The ideal candidate will have strong expertise in Python and Django, h... Show more
A leading data consulting firm is seeking a Data Engineer for a client in Toronto.The role requires experience with Azure, Databricks, and strong skills in data analysis and integration methodologi... Show more
AWS Cloud Platform Engineer – Azure & Automation.Terms: Contract through October 2026.Location: Hybrid twice a month is preferred with an office in Downtown Toronto; however, open to remote for the... Show more
Supports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis.Applies experience and seasoned knowledge, skills, and practices to perfo... Show more
An analytics consulting firm in Toronto is seeking a Data Engineer to architect and implement advanced analytics capabilities.The ideal candidate will have over 12 years of experience in data engin... Show more
A technology recruiting firm in Toronto is seeking a Business Operations Manager for a 12-month contract.The role involves supporting the migration of Capital Market Analytics assets to cloud platf... Show more
An international IT consulting firm is seeking a mid-level or senior Data Engineer to support a global pharmaceutical project.Responsibilities include reviewing data engineering designs, performing... Show more
A data solutions company in Toronto is looking for a Senior Data Platform Engineer to design, build, and scale data platforms for mission-critical government technology solutions.The ideal candidat... Show more
A leading IT consultancy is seeking a Mid-Senior Level Data Engineer for a contract role in Toronto.Candidates will design, develop, and maintain scalable data pipelines, ensuring data quality and ... Show more
Join Riverside Natural Foods Ltd.Canadian-based, family-owned, and globally operating business.As a B-Corp certified, Triple-Bottom Line company, we manufacture nutritious, 'better-for-you' snacks ... Show more
A global digital library service is seeking a Software Engineer II to design and optimize scalable systems within their ML Data Engineering team.The role focuses on building event-driven solutions ... Show more
Accelerate data-driven transformation as a Senior Solutions Engineer at Databricks in Toronto, ON.Utilize your expertise in ML and AI to provide strategic guidance to large enterprises.In this infl... Show more
A leading data solutions company is seeking a Senior Data Engineer to join their fully remote team.In this role, you will design and build scalable ETL/ELT pipelines using Databricks on AWS, ensuri... Show more
Take the lead as a Senior Platform Engineer, focusing on innovative AI solutions and data management.This hybrid role emphasizes optimizing infrastructures and collaborating with diverse teams.Your... Show more
){kind=logo}
