Data Engineer / Big Data Developer

Overview

Data Engineer / Big Data Developer role at J&M Group .

Responsibilities

• Design and implement ETL / ELT pipelines using Databricks, Apache Spark, and Delta Lake.
• Develop and manage data lakehouse architectures in cloud environments (Azure, AWS, or GCP).
• Collaborate with data scientists to prep data for AI / ML model training and evaluation.
• Optimize workflows for performance, scalability, and cost-efficiency.
• Implement data quality, monitoring, and governance practices.
• Automate data ingestion from diverse sources (APIs, databases, streaming).
• Integrate with CI / CD pipelines, version control systems (Git, Azure DevOps), and infrastructure-as-code.
• Ensure adherence to data privacy, security, and compliance standards.

Qualifications

Seniority level

Employment type

Job function

Industries

#J-18808-Ljbffr