You will collaborate with the Data and AI team to develop and implement data integration strategies, build data pipelines, perform data modeling, ensure data governance, and plan scalable solutions. You will work with various business units to handle diverse data objects from disparate systems, contributing to the organization's data management and analytics initiatives.
Key Responsibilities :
Collaborate with the technical teams to design and implement data integration solutions.
Build, maintain and optimize data fapic infrastructure.
Develop and maintain data pipelines using tools such as Apache Spark, Azure Data Factory, and other relevant technologies.
Perform data modeling, including dimensional modeling, to create structured datasets for analytics and reporting purposes.
Ensure data governance practices are followed to maintain data quality, integrity, and compliance with industry standards.
Plan and implement scalable data solutions on cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
Interface with multiple groups within the organization to understand data requirements and deliver effective data solutions.
Implement data security best practices and ensure compliance with data privacy regulations (e.g., GDPR, CCPA).
Work in an Agile environment, collaborating with cross-functional teams and using project management tools to deliver projects effectively.
Requirements :
Bachelor's degree in Computer Science, Data Engineering, or related field. Master's degree or relevant certifications are a plus.
Strong experience as a Data Engineer in a similar industry environment (waste management, material supply, construction).
Proficiency in SQL, Python, data integration, ETL processes, and data governance.
Hands-on experience with cloud platforms (e.g., Microsoft Azure) and data technologies (e.g., Hadoop, Apache Spark).
Knowledge of data warehousing concepts, data lake architecture, and dimensional modeling.
Experience with data visualization tools (e.g., Tableau, Power BI) and creating dashboards for stakeholders.
Familiarity with Agile methodologies, project management tools, and collaboration skills.
Strong problem-solving skills, attention to detail, and ability to communicate effectively.