Description : We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment.
Additionally, familiarity with Dynamics 365 and experience in IoT (Internet of Things) would be highly beneficial.Responsibilities : · Design, develop, and maintain data pipelines using Azure Data Factory for efficient data ingestion, transformation, and processing.
- Implement and optimize SQL Server databases to ensure high performance, scalability, and reliability of data solutions.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.· Build and maintain ETL processes to extract, transform, and load data from various sources into Azure Cloud environments.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues and bottlenecks.· Implement data security and privacy measures to ensure compliance with regulatory standards.
- Work closely with stakeholders to gather and analyze data requirements, providing insights and recommendations for data-driven decision-making.
- Stay updated with the latest technologies and best practices in data engineering, contributing to the continuous improvement of our data infrastructure.
Requirements : · Bachelor's degree in Computer Science, Engineering, or a related field.· Proven experience as a Data Engineer or similar role, with a strong background in SQL Server and Azure Data Factory.
- In-depth knowledge of data ingestion architecture within the Azure Cloud environment.· Experience with Dynamics 365 is highly desirable.
- Familiarity with IoT technologies and platforms would be advantageous.· Proficiency in SQL, T-SQL, and scripting languages such as Python or PowerShell.
- Solid understanding of data modeling, data warehousing, and database design principles.· Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues.
- Excellent communication and teamwork abilities, with a focus on delivering high-quality solutions that meet business requirements.
- Proven track record of successfully building data driven solutions using integration, big-data processing and database and storage technologies.
- Understanding of enterprise data management concepts (Data Governance, Data Engineering, Data Science, Data Lake, Data Warehouse, Data Sharing, Data Applications)
Data Engineer
Applying to the position, you may join one of the most respected and fastest growing institutional investors in the world.Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability.The company invests in all major asset classes,...
Staff Data Engineer
You will have a deep understanding of data architecture, data engineering, data analysis, and reporting -- and a basic understanding of data science techniques and workflows, as well as the business processes supported by the data pipelines. The Kraft Heinz Information Technology organization is hir...
Senior Data Engineer
Job Description: Senior Data Engineer. We are seeking a talented and experienced Senior Data Engineer to join our dynamic team. Proficiently write, optimize, and maintain Python code for data processing, ETL pipelines, and data transformations. Collaborate with data scientists and analysts to implem...
Junior Data Engineer
We are seeking a Junior Data Engineer with an analytical mindset and a passion for using data to drive decision-making. As a member of our team, you will play a vital role in developing and interpreting data insights, as well as building and maintaining data pipelines and dashboards. Design, develop...
Senior Data Engineer
Applying to the position, you may join one of the most respected and fastest growing institutional investors in the world.Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability.The company invests in all major asset classes,...
Senior Data Engineer
A solid foundation in data structures, distributed systems, algorithms, data modeling, data pipeline processes, data integration patterns and software design. The Senior Data Engineerwill be responsible for designing, developing, and supporting the implementation of high-quality and sustainable data...
Senior Software Engineer, Data Platform
The Enterprise Data Services (EDP) team plays a critical role in building and maintaining Getty's data, AI, and engineering platform. The EDP team collaborates with several partner teams, including Customer Data Science, Search, Business Intelligence (BI), and more, to deliver scalable, reliable, an...
Sr Data Engineer
Experiencein implementing ETL pipelineE2E.Workingwith Delta and Parquet formatfiles.Experiencein Autoloader andDLT....
Full Stack Engineer, Internal Data Products
Familiarity with relational and non-relational databases, and ability to design and optimize data schemas to support efficient querying and data processing, optimizing data pipelines, and ensuring seamless data flow across systems. As a Full Stack Engineer in our Internal Data Product Team, you will...
Senior Data Science Engineer
Our client, a leading financial services provider in the insurance industry, is seeking a talented Senior Data Science Engineer to join their team. Track hardware globally in end-user and hosted environments (private and public cloud, and data center). Skills in analyzing CMDB data to highlight anom...