Azure Data Architect

Role : Azure Data Architect

Location : Toronto. ON (Hybrid)

Term : Contract

Mandatory Skills Azure Data Bricks, ADF, Python, Spark, SQL, Unix Shell Scripting

Additional Skills CICD, TFS, Git, Agile Methodology, Jira

12 to 15 years of Total Experience and 8+ years of experience in Architecting / designing and implementing ETL based solutions / applications and understanding of cloud service and deployment model.

First-hand experience and strong technical knowledge in ETL, software design and development and implementation using ADF, ADB, SQL Server, Python, Spark

Very Good experience in development of ETL Jobs and Managing ADF Jobs, Data Bricks Pipelines and Azure servers.

Ability to translate business requirements into fully functioning ETL workflows.

Perform data analysis, data modelling, data migration, performance-tuning & change control.

Experience in UNIX shell scripting.

Experience in managing data lineage and performing impact analysis - Experience in designing and implementing data stores and data marts.

Experience using scheduling tools like Control M, Autosys etc.

Experience in Analysing ETL requirements, designing and implementing complex ETL Jobs, and maintaining ADF, ADB Pipelines and Data flows.

Experience in designing and delivering complex large volume data warehouse applications using ADF and Data Bricks

Organize data at different aggregation levels hierarchies Write complex data transformation logic.

Experience in designing the data integration jobs fault tolerant and scalable.

Cloud experience is necessary (Azure)

Experience in implementing Application security, Data Security (Data Anonymization) requirements.

Experience in CICD Implementations, knowledge of GitHub, Jira and TFS

Experience with Agile development methodology.

• Excellent problem solving / analytical skills and complex troubleshooting methods.
• Effective communication and Presentation skills.
• Certified in Azure Architecture

Key Responsibilities

• Architecting, Planning and Implementation of end- to- end Data Warehouse and Business Intelligence systems utilizing best practices from Data Architecture, Data Integration and Data Management areas.
• Establish data standards and templates to improve quality and integrity of data.
• Implementing application security and Data Security and Anonymization requirements as per specifications
• Integration of diverse data sources with the EDW using ADF and ADB
• Developing Analysis Model for the business subject areas. Identify and understand Source Data Systems. Map Source System Data to EDW Data Model.
• Performance Tuning of the ETL Load Jobs
• Prepare the Design for data pipelines and data flow for large volume of data.
• Create, Configure and Manage Azure Instances, Resources and Servers. Provide Inputs on Capacity Planning.
• Troubleshoot ETL Application issues to determine root causes and fix issues in Prod / QA / UAT / Parallel and Dev
• Review ETL Framework and provide inputs for system improvement ideas and work with team to implement the best approach.
• Provide leadership to the team in implementing technical solution.

Follow Agile Process Methodology to ensure effective communication and faster development cycles. Co-Ordinate with stakeholders (Scrum Master, Architect, PM Etc) in agile ceremonies and provide required updates.