Position Overview
We are seeking a talented and experienced Data Engineer to design, develop, and maintain efficient data pipelines and architectures. In this role, you will play a pivotal part in building and optimizing our data infrastructure to ensure seamless data processing, analytics, and insights across the organization.
Key Responsibilities
- Develop, maintain, and optimize scalable ETL pipelines to process structured and unstructured data from diverse sources.
- Design and implement data architectures to meet technical and business requirements.
- Collaborate with business analysts and software engineers to support analytics, machine learning, and reporting initiatives.
- Monitor and troubleshoot data pipelines to ensure data quality, accuracy, and availability.
- Enhance data warehouse performance through optimization techniques.
- Leverage Microsoft Fabric to store, process, and analyze large-scale datasets.
- Ensure adherence to data security, governance, and compliance standards.
- Create and maintain comprehensive technical documentation for data systems, processes, and workflows.
- Automate data ingestion, transformation, and storage processes.
- Stay informed on emerging technologies and best practices in data engineering.
Qualifications
Required :
Education : Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent work experience).Experience :5+ years in data engineering or related roles.3+ years of experience with T-SQL (Microsoft SQL Server).5+ years working with ETL tools and frameworks (e.g., Azure Data Factory).2+ years of experience with programming languages for data manipulation, such as Python.Expertise with cloud-based platforms (Azure) and data services (e.g., Azure Data Lake, Azure Synapse, Azure SQL Database).Strong knowledge of data warehousing concepts, data modeling, and architectural principles.Familiarity with data visualization tools like Power BI (preferred).Excellent problem-solving, analytical, and communication skills.Preferred :
Experience with real-time streaming tools (e.g., Azure Stream Analytics).Knowledge of machine learning pipelines and model deployment workflows.Relevant certifications, such as Microsoft Certified : Azure Data Engineer Associate or Microsoft Certified : Fabric Analytics Engineer Associate.Familiarity with data governance frameworks and tools.Practical experience with Microsoft Fabric .