Position : Apache Airflow Data EngineerClient : Financial Services ClientLocation : Toronto Hybrid Duration : 3 Months initial contractSecurity Clearance : N / ALanguage : English Background : Kyndryl Canada is supporting our Financial Services client and their project to build and maintain ETL pipelines to process and move data more efficiently.
Qualifications : Extensive experience working with Apache Airflow.Experience working with data process automation.Ability to work on-site in downtown Toronto, multiple days a week.
Responsibilities could entail :
- Data Pipeline Development : Build and maintain ETL pipelines to process and move data efficiently.
- Workflow Orchestration : Use Apache Airflow to schedule and manage complex data workflows.
- Automation : Automate data processing tasks to ensure they run reliably and on time.
- Performance Optimization : Optimize data pipelines for speed and efficiency.
- Monitoring and Logging : Monitor pipeline performance and maintain detailed logs for troubleshooting.
- Collaboration : Work with data scientists and analysts to meet data needs.
Data Engineer (Vertica OR Snowflake & Airflow OR Spark)
Must Have skills:Vertica OR SnowflakeAirflow OR SparkKubernetesJD:Experience with OLAP databases such as Vertica and or Snowflake. Familiarity with data pipelines that use Airflow and Spark or equivalent tools. On-board NRT data pipeline as per business requirement Performance tuning of bad performi...
Data Engineer (Airflow)
Position: Apache Airflow Data EngineerClient: Financial Services ClientLocation: Toronto – Hybrid Duration: 3 Months initial contractSecurity Clearance: N/ALanguage: English Background: Kyndryl Canada is supporting our Financial Services client and their project to build and maintain ETL pipelines ...
Data Engineer (Airflow)
Data Pipeline Development: Build and maintain ETL pipelines to process and move data efficiently. Workflow Orchestration: Use Apache Airflow to schedule and manage complex data workflows. Collaboration: Work with data scientists and analysts to meet data needs. Kyndryl Canada is supporting our Finan...
Data Engineer (Vertica OR Snowflake & Airflow OR Spark)
Familiarity with data pipelines that use Airflow and Spark or equivalent tools. On-board NRT data pipeline as per business requirement Performance tuning of bad performing queries and data model redesign. Experience with OLAP databases such as Vertica and or Snowflake. Creating Vertica Snowflake dat...
Data Engineer
Data Engineer Location Address: Toronto, ON (1-2 days a week)Contract Duration: 1 yearNumber of Positions: 1Schedule Hours: 9am-5pmMust Have Skills/Requirements:1) 8+ years' experience as a Data Engineer2) Experience in building data software; experience with DataStage3) Experience working with Pyth...
DevOps Engineer
DevOps, Site Reliability Engineering, and/or automation engineering. We are looking for a motivated and collaborative DevOps Engineer to join our Cloud Security and Infrastructure team. As a DevOps Engineer, you will have responsibility for building and maintaining cloud based infrastructure. AWS De...
Data Engineer - Tableau
Work and develop in the Data Science and Data Engineering area. Data Management and Data warehouse knowledge. AlteryxTableauData story telling experience. ...
Senior Software Engineer, Data Pipelines
Data Pipelines is at the heart of all critical data flowing through Lyft supporting hundreds of services that impact millions of drivers and passengers every day. We support Kafka as our primary data streaming platform and offer a number of services to manage data and make it available to our intern...
Linux/DevOps Engineer
As a Linux/DevOps Engineer you will be an instrumental part of the engineering team and will be the key person keeping all systems operational. Our engineering team plays a vital role in building the powerful technology that allows us to deliver knowledge to our clients faster and more efficiently. ...
Sr DevOps Engineer
As a sr DevOps Software Engineer, you will actively interface with software developers, product managers, test engineers and administrators on projects d to design and develop the build, release, and deploy toolchain for DevOps while providing on-call support. Systems Engineering and DevOps role is ...