Data Engineer Lead

Title : Sr. Data Engineer Lead Location : Toronto, Ontario  Duration : Contract Job Description :

8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.

Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc

Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers, lambda, red shift, Athena, s3, EC2, IAM, Monitoring and Logging mechanisms- AWS CloudWatch, setting up alerts.

Deployment knowledge on cloud. Integrate CI / CD pipeline to build artifacts and deploy changed to higher Environments.

Scheduling frame works Airflow, AWS Step functions

Excellent Communication skills, should be able to work collaboratively with other teams