Job descriptionIf you are interested kindly send the following documents to [email removed] by Wednesday, Jun 17, 10:00 AM EST if that interests you and matches your profile.
• Updated Resume in word format (Mandatory)
• References (Mandatory)
• Expected hourly rate (Mandatory)
• Visa Status (Mandatory)
• LinkedIn ID (Mandatory)
Client: Ministry of Public and Business Service Delivery and Procurement
Work Location: 5700 Yonge St., Toronto Ontario, Onsite
Estimated Start Date: [phone removed]
Estimated End Date: [phone removed]
#Business Days: 457.00
Extension: Probable after the initial mandate
Hours per day or Week: 7.25 hours per day
Security Level: CRJMC
Must Have
• Data engineering (pandas, spark)
• Data Lakehouse solutions such as Databricks (Delta Lake).
• Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
• Experience using AWS Services such as Glue, Step Functions, Lambda, S3
• Extract/Transform/Load data using tools such as Informatica IDMC
RoleOverview
Responsibilities
Design, Develop, Test, Implement, And Troubleshoot
• data pipelines using various tools such as Databricks, Azure Data Factory, AWS Glue
• complex data transformation procedures
• data models for data warehouses and lake houses
Experience And Skill Set Requirements
Data Engineering Experience - (40%)
• Programming & scripting: Python, SQL, Linux shell, PowerShell.
• Data manipulation/analysis using pandas and spark.
• Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data.
Cloud Experience - (25%)
• AWS and/or Azure services.
• Cloud data warehouse solutions such as AWS Redshift.
• Data Lakehouse solutions such as Databricks (Delta Lake).
• Data processing orchestration/automation.
Data Warehouse - (25%)
• ETL tools (such as Azure Data Factory, AWS Glue) as well as cloud agnostic tools such as Informatica IDMC.
• Data modeling & architecture: relational and dimensional modeling.
• Data reporting/visualization.
Other Skills - (5%)
• Full SDLC from requirements gathering, design, implementation, testing to deployment and production support.
• Project management (agile/scrum and waterfall).
• Change and Incident management.
• Communication, presentation and negotiation skills.
• Consulting, problem-solving and decision-making skills.
Public Sector - (5%)
• Experience working in OPS and/or public sector in general.
Note
Assignment Type: This position is listed as Onsite; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8:00-5:00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location.
• 5 days Onsite