Lead Data Engineer

Kainos
Nova Scotia, Canada
150K $ / an (estimé)
Temps plein

JOB DESCRIPTION

When you join Kainos, you get to think beyond limitations to make an immediate and positive impact like transforming digital services for millions of citizens or helping Fortune 500 companies get live and thrive on Workday.

You’ll be part of a people-first culture that is growing around the world. We’re a creative, committed, and diverse group of individuals who succeed as a team.

At Kainos your ideas are heard and valued and you’ll leave a legacy that you can feel proud of. Join us and discover how our people write our story.

As a Lead Data Engineer (Consultant) at Kainos you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale.

Working in agile teams, Lead Data Engineers provide strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.

Your responsibilities will include :

Taking responsibility for the development of whole components or subsystems within a team. Development incorporates design, code, test and defect resolution.

Focusing on hands-on design and development, using open source and commercial platforms.

Defining and enforcing development best practice and coaching team members to ensure consistency.

Working with project architects, taking responsibility for non-functional needs of ETL / ELT data processing pipelines such as robustness and performance.

Taking responsibility for standards and execution of unit and integration testing done within the team.

Taking responsibility for software product due diligence and integration.

Leading troubleshooting and tuning of activities.

Working with Operations teams to ensure the application software is operationally ready.

Working with Security Architects and accreditors to ensure compliance with relevant legal and security requirements

Advising customers and managers and other team members of the estimated effort and technical implications of user stories and user journeys.

Contributing to technical proposals as part of the sales process.

Managing, coaching and developing a small number of staff, with a focus on managing employee performance and assisting in their career development.

You’ll also provide direction for your team as you solve problems together

Minimum (essential) requirements :

Experience of leading a team of engineers in the implementation of data-intensive system components

Experience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment)

Proficient software development experience in one of J ava, Scala, or Python

Software development experience with data-processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools

Expert in SQL or SQL extensions for analytical use case

Expert understanding of distributed data stores and data processing frameworks

Ability to simply and clearly communicate technical design both written and verbally

Proficient in designing analytical and operational data models

Desirable :

Comfortable with Data Warehouse methodsandtechniques

Actively shares their thoughts and views on data practices

AWS / Azure / GCP Certified in Data Services

Expertise in continuous improvement and sharing input on data best practice

Participation in development and / or technology communities

Who you are :

  • Our vision is to enable outstanding people to create digital solutions that have a positive impact on people’s lives. Our values aren't abstract;
  • they are the behaviours we expect from each other every day, and underpin everything that we do. We expect everyone to display our values by being determined in how obstacles are overcome;

honest when dealing with others; respectful of how you treat others; creative to find solutions to complex problems and cooperative by sharing information, knowledge and experience.

These values, applied collectively, help to produce an outstanding Kainos person, team and culture.

About us

Kainos is a high-growth IT services company providing digital technology solutions and agile software development to enterprise customers.

Across our 30-year history, we have worked on transformational projects across government, NHS and a myriad of private sector clients.

So what are you waiting for? Let’s write the next incredible chapter of our story together.

Embracing our differences

At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive.

We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are.

We also believe every candidate deserves a level playing field. Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out.

We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.

Il y a plus de 30 jours
Emplois reliés
Raise
Halifax, Nova Scotia

Monitor and optimize ARC platform data pipelines to ensure efficient data flow and system performance, applying best practices in data engineering for ongoing maintenance. Implement and manage data access policies in coordination with the Data Governance and Engineering team, ensuring secure and com...

RBC - Royal Bank
Halifax, Nouvelle-Écosse

Lead Engineer, Climate Solutions is responsible for leading development of applications for large-scale data processing and analysis. Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirement...

Kainos
Nova Scotia, Canada

As a Lead Data Engineer (Consultant) at Kainos you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers provide strong development leadership for team members an...

0000050007 Royal Bank of Canada
Halifax, Nouvelle-Écosse

Architect and Design Data Platform: Lead the conceptualization and design of a robust data platform capable of supporting various data types and sources across the organization. Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Prob...

Offre sponsorisée
Outlier
Halifax, Nouvelle-Écosse
Télétravail

Are you an experienced software engineer who would like to lend your coding expertise to train AI models?. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. W...

Vidyard
Remote, Canada
Télétravail

Data Science at Vidyard is aimed at using data, analytics, and sciences to improve various aspects of our business. You are comfortable working with large data sets and analyzing complex data with SQL and other tools such as AWS Redshift, DBT and Cube. Research and Development team, leading experime...

Jay Analytix
Canada

Computer Science, Electrical Engineering, or a related field with a focus on speech processing or machine learning. This role requires a deep understanding of speech processing, machine learning, and software development. Strong knowledge of machine learning frameworks such as TensorFlow, PyTorch, o...

PAL Airlines
Halifax, Nouvelle-Écosse

Experience with Artifactory, AzureDevOps, Git. Bachelor or Master degree of Computer Science or Software Engineering. ...

Lime
Canada

Experience employing a variety of machine learning techniques. We work closely with data scientists, local operators who know their city block-by-block and engineering teams across the stack. Join as a Staff ML Engineer to tackle this complex and multi-faceted problem as well as a variety of other M...

Wawanesa Insurance
Dartmouth, Nouvelle-Écosse

The Senior Machine Learning Operations Engineer is responsible for design, development, deployment, and monitoring of machine learning models. The engineer works closely with Data Analysts, ML Engineers in Analytics Exploration and collaborates with Software and Data Engineers to ensure infrastructu...