Data Engineer (big data processing or relational databases with SQL)
Toronto
Role name : Engineer
Role Description : 1 Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
2 Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions3 Develop big data and analytic solutions leveraging new or existing technology to advance Manulife'
s all lines of business4 Exploratory data analysis by querying and processing data stores and databases and generate reports.
5 Design, upgrade and implement new data workflows.6 Write and maintain technical documentation7 Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments
Competencies : Data Structures
Experience (Years) : 4-6
Essential Skills : Experience working as Data Engineer with focus on big data processing and / or relational databases with good understanding of SQL Experienced with working on Structured and Semi-Structured datasets.
Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure DataBricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries Experienced with Workflow Management Tools : Airflow, Crontab, CA Workload Automation Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments Experience with integrating to back-end / legacy environments Experience integrating business and technology teams Experienced in any of the following programming / scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
Desirable Skills : Previous work experience in the financial sector (insurance or benefits industry). Knowledgeable or at least have the basic concept of Data Visualization in any of the following tools : Tableau, PowerBI, QlikView / QlikSense
Quality Engineer with Data
We have a great opportunity with one of IRIS's Banking clients in Canada is looking for the Sr Data Tester in Toronto Ontario Hybrid. In a program sponsored by Price Waterhouse, PNC Bank and Marsh, Iris has been honored for being. CMMi Level 5 New Jersey based company providing information technolog...
Big Data Developer with Java
Nice to Have Experience in building data pipelines on AWS/Azure and/or Databricks. Big Data applications using Java/Scala and Spark on Cloudera/HDP. Ability to work with multiple stakeholders business and technical. Hadoop Spark and Java/Scala Developer with Minimum 5 years of hands-on e...
Senior Data Engineer
Give a Damn! (We are deeply commited and passionate about our work and achieving results)Benefits, Culture, & More:· Strong work life blend · Flexible work arrangements (wfh, remote, or access to one of our office spaces)· Employee Stock Options · Unlimited vacation · Competitive pay and benefits· P...
Data Engineer
As a member of the Data team, the Data Engineer will build, configure, secure, migrate, optimize, and refactor Azure data platform solutions which includes Ingestion, ETL/ELT, Storage, Data Lakes, Delta Lakes, Data Warehouses, Lakehouse and Data Modelling. The Data Engineer will be capable of workin...
Azure Data Engineer
Experience in developing Data Factory pipelines that are parametrized and reusable and worked on most of the ADF control flow activities like Get Metadata, Lookup, Copy, For Each, Databricks, Stored Procedure, If Web etc. Azure Data Factory, Azure Databricks, Azure DataLake Storage, Azure Synapse. E...
Software Engineer Data
Embrace the opportunity to work on amultinational Fortune 500 project in Canada as a Software EngineerData. Collaborateon engineering projects for products with a diverse global team ofresearchers and engineers. Processlarge unstructured disparate multimodal (text images 3D models codesnippets metad...
GCP Data Engineer
Knowledge on SQL and NoSQL database (Cassandra). Experience on GCP, Google BigQuery and Composer. Experience on managing data on Cloud; GCP preferable. Significant exposure to Python, Java or Scala. ...
Senior Engineer - Data Governance and Quality - Deloitte Global Technology
The data governance and data quality engineer is an individual contributor that provides specialized technical and functional expertise that works in collaboration with functional teams and stakeholders to modeling, developing, enhancing and deploying technical components related to the data governa...
Senior Consultant, Data Privacy Engineer
Responsible for assisting with the management of the data privacy, data protection, data usability, performance and the integrity of the privacy solution. The implementations should advance compliance with legal forms of data use as well as support business use of data. Interface with other develope...
Sr. Technical Project Manager
You will work alongside a team of passionate, creative developers to brainstorm and plan our scrums on whiteboards, communicating with your team or communicating across other functions to avoid potential issues in the project plan. You'll start each day with a scrum, working with a team to understan...