Senior Azure Data Engineer - Big Data, Hadoop, Lakehouse Architecture

Job Description

Essential Skills:

· Data Engineering

· Big Data and Hadoop Ecosystems

Role Description:

· Requires experience in: Hadoop, Rahona, Synapse, Data Analytics, Lakehouse architecture and Databricks.

· Design, build and maintain scalable data solutions on Microsoft Azure.

· Develop and manage data pipelines using Azure Data Factory, Databricks and related services.

· Implement data storage solutions such as Azure Data Lake, Azure SQL Database and Cosmos DB.

· Ensure data quality, security and compliance across all Azure data platforms.

· Perform data integration, transformation and migration tasks from various sources to Azure.

· Monitor, troubleshoot and optimize data workflows for performance and cost efficiency.

· Collaborate with data architects, analysts and business stakeholders to understand data requirements.

· Automate data processing and reporting tasks using Azure tools and scripting languages.

· Document data processes, architectures and best practices.

· Stay updated with the latest Azure data services and recommend improvements or new technologies as needed.

Experience Required: 6-8

Requirements
Essential Skills: • Data Engineering • Big Data and Hadoop Ecosystems • Microsoft Azure Role Description: • Requires experience in: Hadoop, Rahona, Synapse, Data Analytics, Lakehouse architecture and Databricks. • Design, build and maintain scalable data solutions on Microsoft Azure. • Develop and manage data pipelines using Azure Data Factory, Databricks and related services. • Implement data storage solutions such as Azure Data Lake, Azure SQL Database and Cosmos DB. • Ensure data quality, security and compliance across all Azure data platforms. • Perform data integration, transformation and migration tasks from various sources to Azure. • Monitor, troubleshoot and optimize data workflows for performance and cost efficiency. • Collaborate with data architects, analysts and business stakeholders to understand data requirements. • Automate data processing and reporting tasks using Azure tools and scripting languages. • Document data processes, architectures and best practices. • Stay updated with the latest Azure data services and recommend improvements or new technologies as needed. Experience Required: 6-8