Data Engineer
Who You Are : · You can demonstrate 5+ years of experience in designing and building data-centric and reporting applications· Good working knowledge of various Azure cloud services such as Azure data factory : Pipelines, data sets, linked services, integrated with Self-hosted integration runtime, mapping, authoring and monitoring data flows.
- Azure data lake : Reading from and writing to from different sources using Azure SDK / APIs / configuration.· Azure Event Hub : Real-time and batch processing of events, consumption of events by SDK / APIs· Azure Key vault : Managing / retrieving required secrets and keys, aware of key vault policies· Azure monitor : To configure alerts on various metrics and analyze for troubleshooting· Strong experience in monitoring and troubleshooting Azure cloud native and hybrid cloud applications.
- Good knowledge of designing and building Azure Function Apps in a robust and scalable manner.Nice to Have : · Experience with building and maintaining data pipelines on the Striim platform.
- Experience with any JavaScript framework, preferably Vue.js· Good knowledge of working with message queue and stream processing systems· Working experience with Azure App service environment· Working knowledge on using Azure AD service principals and its usage for authentication and authorization scenarios· Strong knowledge in writing and troubleshooting MS SQL queries and Stored Procedures.
- Experience in Power BI Reports and analytics.· Experience building and integrating with external systems using SOAP / REST API connectors.
- Experience in Building REST APIs.· Knowledge and experience of using GIT and Azure DevOps.· You embrace and advocate change.
You'll continuously evolve your thinking and the way you work to deliver your best.· Your influence makes a difference. You know that relationships and networks are essential to success.
You inspire outcomes by sharing your expertise.· You’re digitally savvy. You seek out innovative solutions and embrace evolving technologies.
You can easily adapt to new tools and trends.· You're motivated by collective success. You know that teamwork can transform a good idea into a great one.
You know that an inclusive team that enjoys working together can bring a vision to life.· Values matter to you. You bring your real self to work and you live our values - trust, teamwork, and accountability.
Education : Bachelor’s degree / University degree or equivalent experience.
AWS Data Platform Engineer (Intermediate)
Apex Systems is a global IT services provider, and our staffing practice has an opening for an Data Platform Engineer with a strong understanding of CDK, exceptional understanding of AWS cloud infrastructure, and solid DevOps Engineering expertise to place at our client, a Big Five Bank. Proven abil...
Data Engineer (Airflow)
Data Pipeline Development: Build and maintain ETL pipelines to process and move data efficiently. Collaboration: Work with data scientists and analysts to meet data needs. Kyndryl Canada is supporting our Financial Services client and their project to build and maintain ETL pipelines to process and ...
Data Engineer - Business Systems
Experience with designing, creating, and maintaining data sets in the Microsoft Fabric: Creating and managing data using a lakehouse/datalakes Designing pipelines to copy data into a lakehouse/datalakes Using notebooks to write code for data ingestion, preparation and transformation. Halff is lookin...
System Development Engineer, Data Management
Ring Data Management is seeking a self-directed System Development Engineer to develop and operate our AWS cloud data processing systems. The Quick Action Service team sifts through petabytes of data per week to extract top-line business metrics around customer experience, operational excellence, an...
Associate Software Engineer, Domain Data Engineering
Associate Software Engineer, Domain Data Engineering. Wayfair Data Engineering is the engine that powers our data-obsessed eCommerce enterprise. You will be instrumental in designing and delivering Data Warehouses, Data Lake, Self-Service Tooling, Real-time Streaming and Big Data Solutions for multi...
Senior Principle Engineer - Data and AI
Domain expertise in the implementation of one or more of the following: AI end to end data processing, scenarios and system optimizations, core database internals (Ex: query optimization, runtime, scheduling, storage engine, transaction processing, etc. Architect and develop framework/engine for th...
Senior Data Engineer
As a Senior Data Engineer, you will play a crucial role in designing, implementing, and optimizing our data infrastructure. Work closely with data engineering to design and implement data models that align with business requirements. Zonda is looking for a passionate Senior Data Engineer to evolve a...
Data Engineer
As a member of the Data team, the Data Engineer will build, configure, secure, migrate, optimize, and refactor Azure data platform solutions which includes Ingestion, ETL/ELT, Storage, Data Lakes, Delta Lakes, Data Warehouses, Lakehouse and Data Modelling. The Azure Data Engineer is a technical lead...
Associate Engineer - Data
The Data Engineer is a critical member of the engineering team, responsible for designing, building, and maintaining robust data systems and infrastructure. Build, Orchestrate and optimize data pipelines to extract, transform, and load (ETL) data from various sources into the organization's data war...
Data Engineer
We are looking for a data engineer who is passionate about analytics and helping companies build and scale data. You enjoy working with data and are motivated to produce high quality data tools and pipelines that help empower other data scientists. Extensive experience working on rela...