Senior Data Engineer to design and implement data ingestion pipelines from multiple sources using Azure Databricks- 74443-1
Position Title : Data Engineer
Line of Business : Decision Science Personal & Business banking
Target Start Date : asap
Duration : 6 months
Remote / Hybrid : Hybrid, twice a week to office
Office Location : 81st bay street, 25th floor
Job Description :
- Proven experience with Miscrosoft Azure platform : Databricks / Python / Spark / SparkSQL and ADF
- Experience with Salesforce platform, i.e : API
- Solid understanding of cloud technologies and tools
- Design and Develop custom ETL Solutions to ingest data into Azure Data Warehouse
- Code data quality and transformation logic for data movement within data warehouse
- Develop code to publish data from data warehouse to data mart for consumption by applications or BI tools
- Designing and implementing data ingestion pipelines from multiple sources using Azure
- Databricks
- Integrating the end to end data pipeline - to take data from source systems to target data
- repositories ensuring the quality and consistency of data is maintained at all times
- 8+ years of progressive work experience in data intensive work environment within finance / banking industries
- Degree in Computer Science, Engineering, Statistics, Management Analytics or a related field of study
- Team player who can effectively contribute and collaborate within a diverse, fast paced dynamic environment
- Interface with business partners to understand requirements and present solutions
- Hybrid working environment, 1 or 2 days per week in office
Must Have Requirement :
1. Experience with Azure - Databricks (preferred) or related technologies 5 years
2. Experience with Python 5 years
3. Experience Spark 5 years
4. Experience with ADF (Azure Data Factory) 5 years
5. Spark SQL experience
6. Cloud experience
Nice to Have :
1. Salesforce experience
2. Previous data architect / modeler experience will be an asset
3. Banking experience
Senior Data Engineer
Collaborate with head office and in-country business partners to Document, analyze, research, and define user and system requirements and features relating to strategic data projects/initiatives. Hands on experience in big data tools and technologies, as well as data visualization and reporting tool...
Data Solutions Engineer (1 year-term)
In-depthworking experience using Azure Cloud services including Azure Data Lake, Azure Databricks and Azure Synapse Analytics. Azure Data Factory and developing data pipelines for data integration. Candidates who are members of Indigenous, Black, racialized and 2SLGBTQ+ communities, persons with dis...
Platform Engineer (Data Bricks and Azure)
Architect scalable and efficient data solutions using Azure Databricks. Design, implement, and manage data pipelines. Data Pipelines and Integration:. Develop Terraform Infrastructure as Code (IaC) to automate Databricks environment deployments. ...
Senior Software Engineer-Performance/Data/Java
Advise on scalability and performance strategies: The engineer will provide guidance and recommendations to engineering teams on how to optimize system performance and scalability. Develop performance tools and infrastructure: The engineer will assist in maintaining and provisioning performance test...
Senior Data Engineer
Knowledge of Docker/ Kubernetes and Strong Computer Science Knowledge; Proficiency in writing clean, maintainable, and efficient Python code; Self-motivated and pro-active with proven ability to work accurately and under pressure to meet deadlines; Strong communication skills - Ability to summarize ...
Manager, CRM Data Enablement and Reporting
By leveraging data from Enterprise Data Warehouse (EDW) as well as Enterprise Data Lake (EDL), develop and prepare reporting datasets and tables using analytical tool such as SAS and Jupyter notebook. Identification and implementation of data, process and infrastructure enhancements to ensure RBC CR...
Supervisor, Data Strategy & Governance
Proficiency in developing data governance tools and frameworks, data modeling and metadata management tools, data quality assessment and improvement tools. Proven experience in data governance, data management, or a related field and a strong understanding of database systems and data integration. O...
Data Architect (Azure)
Additionally, you will play an integral part in adding new and crucial data pipelines to ingest and cleanse data sources, which are fundamental to bringing Altis Recruitment to the forefront of Data Analytics. Must have experience in leading a data warehouse implementation, including implementation ...
Senior Data Scientist, AML Analytics
Utilizing sophisticated tools and techniques the Senior Data Scientist of Global AML Transaction Monitoring will develop and tune new and existing solutions used to identify suspicious activity, analyze data to identify RBC clients who present an elevated level of risk (financial & reputational) and...
Senior Associate/Portfolio Manager Sector Data Analyst
We are recruiting for a Senior Associate/Portfolio Manager Sector Data Analyst to integrate data driven insights into the alpha generation process by leveraging alternative data in supporting sector focused investment teams. Act as sector data domain expert by becoming deeply familiar with industry ...