UnionSys Technologies-Azure Data Engineer

Job Title: Azure Data Engineer
Experience: 6-8 Years
Location: Bangalore, Pune, Hyderabad (5 Days WFO - Client Location)

Job Description:

Unionsys Technologies is looking for a highly skilled Azure Data Engineer with 6-8 years of experience to join our dynamic team. The ideal candidate will have hands-on expertise in Azure-based data engineering solutions, including Azure Databricks, Azure Data Factory, Azure Data Lake, and PySpark. This role requires strong experience in Databricks Jobs, Scheduling, Orchestration, Workflow, and REST API integration.

Key Responsibilities:

• Develop and implement data engineering solutions using Azure services such as Databricks, Data Factory, and Data Lake.
• Work extensively with PySpark to process and transform large datasets efficiently.
• Design, implement, and optimize Delta Lake architecture for scalable data storage and management.
• Manage Databricks Jobs, Scheduling, Orchestration, Workflow, and REST API integration.
• Collaborate with cross-functional teams to understand business requirements and translate them into data solutions.
• Ensure data integrity, quality, and security in cloud-based data platforms.
• Optimize data pipelines for performance and cost-efficiency.
• Troubleshoot and resolve data processing issues in the Azure ecosystem.

Required Skills & Qualifications:

• Mandatory Skills:
  • Azure Databricks, Azure Data Factory, Azure Data Lake, and PySpark
  • Strong knowledge of Databricks Jobs, Scheduling, Orchestration, and REST API integration
  • Hands-on experience with Delta Lake Architecture and Implementation
  • Good understanding of Data Engineering concepts and best practices
• Experience in building and maintaining scalable ETL/ELT pipelines.
• Knowledge of SQL, Python, and Spark for data processing and transformation.
• Strong problem-solving skills and ability to work in a fast-paced environment.
• Experience in working with large-scale data processing and distributed computing.
• Familiarity with CI/CD pipelines and DevOps practices is a plus.

Preferred Qualifications:

• Experience in Azure Synapse Analytics, Power BI, or other cloud-based data services.
• Knowledge of Machine Learning and AI-based data processing techniques.
• Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are an added advantage.

Work Environment & Benefits:

• Work from the client location (5 Days WFO) in Bangalore, Pune, or Hyderabad.
• Opportunity to work on cutting-edge cloud data technologies.
• Competitive salary and growth opportunities in a fast-growing technology firm.
• Collaborative and innovative work culture.

If you are an experienced Azure Data Engineer with a passion for data-driven solutions, we would love to hear from you!