Senior Azure Data Engineer
Azure Data EngineerApex Systems is a global IT services provider and our consulting practice has an opening for a Sr. Azure Engineer who has experience with Azure Data Factory Data Bricks and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank.
Client : Big 5 BankPositions : 1Location : Hybrid Toronto 1-2 days / weekTerms : 6 Month Contract, strong possibility of extensionHours : 37.
5 hours / week Monday-FridayRequired Skills : 7+ years of professional experience with database technologies and ETL tools2+ years of hands-on Azure ADF and Azure Databricks(PySpark).
SkillsWorking experience on Azure SQL, ADF, Databricks and has strong knowledge on Datawarehouse concept.Strong knowledge on database with experience on SQL performance tuning.
Proven experience in designing and developing automated processes in using JSON, Parquet, XML, Fixed width, csv - file formats.
Should be able to architect scalable and reliable ETL data solution using Azure Service Stacks using - Azure Data Factory, Azure SQL Database, AZURE Data Warehouse, Azure data bricks, Azure Blob Storage etc.
Experience with Devops practices and tools for data engineering (eg Azure Devops , CI / CD pipelines)Good to have certification in MS Azure Data Engineer.
Roles / Responsibilities : Lead the design, implement and maintenance of data solutions on Azure.Works with development teams and senior designers to capture requirements.
Conduct impact assessment with business in order and determine high level design and size of effort based on requirements.
Work with team to ensure standards and patterns are followed. Identifies opportunities for new architectural initiatives makes recommendations on the increasing scalability and robustness of platforms and solutions.
Support Azure developers by providing technical assistance troubleshooting and alternative development solutions.Playing a key role in mentoring other staff members and a proven track record in knowledge transfer to other team members and departments.
Identifies necessary changes to current business process.Communicates risks and ensures understanding of these risks.Responsible for leading the design of prototypes and determining final design to ensure client satisfaction with product.
Knowledge of data governance, security, and compliance practices
Senior Data Engineer
Job Description: Senior Data Engineer. Position Overview: We are seeking a highly skilled Senior Data Engineer to join our client's dynamic team. The ideal candidate will have 5-7 years of experience in data engineering, working with very large data sets, and a strong background in AWS, Python, and ...
Senior Data Engineer
You will contribute to the development and implementation of data pipelines and ETL processes to extract, transform, and load data into Manulife's data warehouse and utilize your expertise in building pipelines using, Python, Azure Data Factory, Databricks, Synapse, SQL server, and Azure functions t...
Azure Data Engineer Lead
As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). Senior/Lead Azure Data Engineer (7+ years) possessing skills in solutions design and hands-on development . Datab...
Senior DevOps Engineer (AWS/Azure)
We are seeking a motivated and skilled Senior DevOps Engineer with a focus on Azure/AWS to join our dynamic team. Live and breath AWS or Azure services such as EC2, S3, RDS, ELB, VPC, EKS, MSK, WAF, EBS, CloudFormation, - CodeDeploy, CloudWatch, VM”s, Blob, Azure LB, Application gateway, VNET, AKS ...
Senior Software Engineer, Data Pipelines
Data Pipelines is at the heart of all critical data flowing through Lyft supporting hundreds of services that impact millions of drivers and passengers every day. We support Kafka as our primary data streaming platform and offer a number of services to manage data and make it available to our intern...
Data & Analytics - Senior Analytics Engineer
Proven skills, education, and/or applicable certifications in: Excellent SQL skills with the ability to create efficient & tune data modelsStrong business modelling skills: going from expressed requirements to an actual data modelVaried design options of reshaping data tablesModern cloud data platfo...
Senior Data Engineer
As a Senior Data Engineer, you will play an instrumental role in advancing our core machine learning solution. You will work alongside scientists and engineers in a collaborative environment, contributing features and data pipelines to power our core recommender systems and our DaVinci Personalizati...
Senior Data Engineer
Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis. We are seeking for a highly skilled Data Engineer to join our team and work on building Data Monetization products. Knowle...
Senior Data Engineer
We are seeking a dynamic and well versed Senior Data Engineer to orchestrate our Data Lake team, with a focus on data curation, report creation, and data feed management. The ideal candidate will possess the qualifications to champion the development and implementation of end-to-end data pipelines u...
Data & Analytics - Senior Analytics Engineer
As the Senior Analytics Engineer, you will support and enable the business, apply data modeling expertise, and become the data domain go-to person. The mission of the Data & Analytics Department is to maximize the value of Aritzia's data by making it available, insightful and actionable to foster a ...