Data Engineer (Airflow)
Position : Apache Airflow Data EngineerClient : Financial Services ClientLocation : Toronto Hybrid Duration : 3 Months initial contractSecurity Clearance : N / ALanguage : English Background : Kyndryl Canada is supporting our Financial Services client and their project to build and maintain ETL pipelines to process and move data more efficiently.
Qualifications : Extensive experience working with Apache Airflow.Experience working with data process automation.Ability to work on-site in downtown Toronto, multiple days a week.
Responsibilities could entail :
- Data Pipeline Development : Build and maintain ETL pipelines to process and move data efficiently.
- Workflow Orchestration : Use Apache Airflow to schedule and manage complex data workflows.
- Automation : Automate data processing tasks to ensure they run reliably and on time.
- Performance Optimization : Optimize data pipelines for speed and efficiency.
- Monitoring and Logging : Monitor pipeline performance and maintain detailed logs for troubleshooting.
- Collaboration : Work with data scientists and analysts to meet data needs.
Data Engineer (Vertica OR Snowflake & Airflow OR Spark)
Familiarity with data pipelines that use Airflow and Spark or equivalent tools. On-board NRT data pipeline as per business requirement Performance tuning of bad performing queries and data model redesign. Experience with OLAP databases such as Vertica and or Snowflake. Creating Vertica Snowflake dat...
Data Engineer (Airflow)
Data Pipeline Development: Build and maintain ETL pipelines to process and move data efficiently. Workflow Orchestration: Use Apache Airflow to schedule and manage complex data workflows. Collaboration: Work with data scientists and analysts to meet data needs. Kyndryl Canada is supporting our Finan...
Senior Data Engineer(Full-Time)100%Remote
Given the rapid pace of change in the data and analytics role, the Senior Data Engineer will also be a key technical visionary for GCRH, helping the company find new efficiencies using technology by building a deep understanding of GCRH’s value proposition and processes, continually staying informed...
Senior Cloud DevOps Engineer
Develops scalable and accessible business cloud applications.Focuses on the technical design, development, enhancement, testing, debugging and maintenance of Cloud applications and supports the design of business processes in the cloud.Applies expertise and in-depth understanding of managed services...
Professional Services Engineers – Mobile Data Network Toronto
Field Support / PS Engineer, Customer Service Engineer. They are looking for a Professional Services Engineer with about 5 yrs experience. The Professional Services Engineer is a key role in the Professional Services (PS). ...
System Development Engineer, Data Management
Ring Data Management is seeking a self-directed System Development Engineer to develop and operate our AWS cloud data processing systems. The Quick Action Service team sifts through petabytes of data per week to extract top-line business metrics around customer experience, operational excellence, an...
Senior Software Engineer, Data Pipelines
Data Pipelines is at the heart of all critical data flowing through Lyft supporting hundreds of services that impact millions of drivers and passengers every day. We support Kafka as our primary data streaming platform and offer a number of services to manage data and make it available to our intern...
DevOps Cloud Engineer (Intermediate) 7606-2616
The DevOps/Cloud Engineer will be responsible for creating and updating service templates used for provisioning cloud resources and installing software required for running the business applications. The DevOps/Cloud Engineer will also be responsible for setting up the DevSecOps pipeline for the bui...
DevOps Engineer
DevOps Engineer, Network Security Group. As a DevOps Engineer, you will be working to improve & expand the CI/CD pipeline (and associated systems) that's used by development teams around the world. Identify & integrate open-source or 3 rd party tools with existing systems to enable engineering teams...
Senior Data Engineer
As a Data Engineer in the Data Engineering team, you will own the tooling, frameworks, data pipelines, integrations, databases, schemas and the data integrity of this cluster. You are critical to both Finix, and our customers, in supplying the data that underpins key operations decisions, uncovers h...