Senior Data Engineer (10+ years) to design and optimize enterprise data solutions using Microsoft
- Indépendant
Our energy and utilities client is seeking a Senior Data Engineer (10+ years) to design and optimize enterprise data solutions using Microsoft Fabric, Azure Databricks, and SAP data integration
Join a large-scale enterprise data modernization initiative supporting analytics, reporting, operational insights, and AI-driven capabilities across multiple business functions. This role focuses on building scalable Microsoft Fabric and Azure Databricks data solutions integrated with SAP environments including Finance, Supply Chain, Asset Management, and Customer Operations. You will contribute to enterprise-grade data products, SAP-to-Fabric ingestion pipelines, and modern cloud data architecture initiatives.
Must Haves
- 10+ years in Data Engineering delivering large-scale ETL/ELT solutions
- 2+ years with Microsoft Fabric in enterprise environments including OneLake and Fabric Data Factory
- 4+ years using Azure Databricks, PySpark, and Spark SQL for large-scale data transformation
- SAP S/4HANA, SAP ECC, SAP BW, and SAP Datasphere data integration within enterprise analytics platforms
- Bachelor's degree in Computer Science, Information Systems, Software Engineering, Data Science, or related discipline
Nice to Have
- Experience within utilities, energy, power generation, or oil & gas environments
- Experience with Asset Management data, Work Management systems, Customer Information Systems, or metering and operational technology data
- Experience integrating SCADA data, IoT data, or real-time streaming data
- Microsoft Fabric Certification, Azure Data Engineer Associate certification, or Databricks Certification
- Exposure to Denodo
Responsibilities
- Design scalable data pipelines within Microsoft Fabric
- Build enterprise data ingestion frameworks for structured and semi-structured data sources
- Develop ETL/ELT processes utilizing Azure Databricks, PySpark, Spark SQL, and Python
- Build integration pipelines extracting data from SAP S/4HANA, SAP ECC, SAP BW/BW4HANA, SAP Datasphere, and SAP SuccessFactors
- Design Fabric-based data products supporting self-service analytics, enterprise reporting, executive dashboards, and predictive analytics initiatives
- Implement data quality controls, metadata management, data lineage, and data cataloging processes
- Support CI/CD deployment processes