Data Engineer
Description :
We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment.
Additionally, familiarity with Dynamics 365 and experience in IoT (Internet of Things) would be highly beneficial.
Responsibilities :
- Design, develop, and maintain data pipelines using Azure Data Factory for efficient data ingestion, transformation, and processing.
- Implement and optimize SQL Server databases to ensure high performance, scalability, and reliability of data solutions.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
- Build and maintain ETL processes to extract, transform, and load data from various sources into Azure Cloud environments.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues and bottlenecks.
- Implement data security and privacy measures to ensure compliance with regulatory standards.
- Work closely with stakeholders to gather and analyze data requirements, providing insights and recommendations for data-driven decision-making.
- Stay updated with the latest technologies and best practices in data engineering, contributing to the continuous improvement of our data infrastructure.
Requirements :
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or similar role, with a strong background in SQL Server and Azure Data Factory.
- In-depth knowledge of data ingestion architecture within the Azure Cloud environment.
- Experience with Dynamics 365 is highly desirable.
- Familiarity with IoT technologies and platforms would be advantageous.
- Proficiency in SQL, T-SQL, and scripting languages such as Python or PowerShell.
- Solid understanding of data modeling, data warehousing, and database design principles.
- Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues.
- Excellent communication and teamwork abilities, with a focus on delivering high-quality solutions that meet business requirements.
- Proven track record of successfully building data driven solutions using integration, big-data processing and database and storage technologies.
- Understanding of enterprise data management concepts (Data Governance, Data Engineering, Data Science, Data Lake, Data Warehouse, Data Sharing, Data Applications)
Data Engineer
Organigram Inc in. wants to hire a Data Engineer. We are looking for candidates like you! You will be in charge of ..
Data Engineer
Senior Backend Engineer. SpotHero. We are looking for a Senior Backend Engineer to join the Operator.. Our Data Stack is. Postgres on RDS for persistence and Redis on ElastiCache for caching and offline task..
Senior Engineer, Backend (Operator Panel Squad)
Staff Backend Engineer. SpotHero. SpotHero is looking for Staff Backend Engineers to join the Operator.. we focus on providing guidance and data driven insights to help our Operators better run their business..
Data Engineer
What You Will Do Work and develop in the Data Science and Data Engineering area Skills and Experience You Will Need Required 2 5 years of experience with the following..
Data Engineer
The role. In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake.. This includes the design and implementation of the Data Lake, as well as the optimization of data..
AWS Data Engineer
Title. AWS Data Engineer Job Location. Toronto, Canada. Day 1 onsite. Hybrid Model) Type. Contract Must Look for 5. Years of experience consultant.(without intern) CDK. Terraform. Typescript..
AWS data Engineer
Skills and Responsibilities. Splunk Engineer (Protect Fusion Security Engineering Data Onboarding) Level.. Technical Requirements It is expected that the Senior Engineer will have expert knowledge in a wide..
Sr. Data Engineer
Responsible for collecting, processing, and performing statistical analyses on large sets of data. They use their expertise in data modeling and data mining to identify trends and patterns in..