Senior Data Engineer

Bitstrapped
Ontario, Canada
Full-time

We are seeking a hands-on Senior Data Engineer in a full-time salaried position. The Sr. Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams.

The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a hands-on consultant to our customers.

The Data Engineer will work mostly on Google Cloud, interacting with other platforms such as AWS or Microsoft Azure in hybrid environments.

Responsibilities

  • Design, implement, automate, and maintain enterprise data systems for our customers
  • Implement data engineering technologies, primarily stream and batch processing systems with Apache Beam / Dataflow, Data Warehouses including BigQuery, queuing and message systems with Pub / Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL and Postgres, Redis, and Composer DAG-based workflow automation
  • Show an ability to implement data system robustness including caches, clustering, partitioning, event windows, performant and cost efficient data warehouse queries, audit tables, data governance and security including RBAC and CBAC
  • Capable of balancing 1-2 client projects with differing project priorities
  • Write reusable and scalable code, prioritizing a test driven approach where possible
  • Experience working with project plans and milestone based sprints, under the supervision of technical project management and principal architects
  • Hands-on experience with relational and non-relational databases, as well as file types that include Parquet, Avro, csv
  • Strong verbal communication skills
  • Possess a desire to continuously learn and adopt new technologies
  • Possess a desire to work in a fast paced environment
  • Be capable of working independently, staying on task, and remaining productive with little supervision

Minimum Requirements

  • 5+ years experience as a data engineer or software engineer in a professional environment
  • 5+ years of experience with data engineering duties including data ingestion, data processing, ETL / ELT, parallel computing, integration of sinks / taps, workflow orchestration
  • Strong knowledge of databases and data storage
  • Ability to architect, develop, and test code at an enterprise level, adhering to software engineering best practices
  • Ability to Design data models with a strong understanding of modeling design patterns.
  • Proficiency in at least one programming language.
  • Has knowledge and experience working on distributed systems (monitoring, alerting, message contracts)
  • Cloud Certifications - GCP Data Engineer certification preferred

Bonus

  • Experience in Data Science and Data Science Engineering
  • Experience with the deployment of workloads to the cloud
  • Experience interacting with other cloud infrastructure services including Cloud Functions, Kubernetes, or VertexAI is a nice to have
  • Experience with DevOps CI / CD workflows using technologies such as Github, Gitlab, Jenkins, CircleCI, Bitbucket, and otherDevOps Technologies.
  • Experience writing infrastructure as code using Terraform

About Bitstrapped

Bitstrapped is a fast-growing consulting firm with Data and AI services practices. Our passion lies in our ability to help companies invest in forward-thinking data-to-AI infrastructure.

Investments in these areas enable our customers to distinguish their brands from their competition, stay competitive, and produce better business outcomes.

We help our customers architect solutions for the cloud, advanced data engineering, MLOps, and AI infrastructure. This includes engineering systems for data ingestion, data transformation, data warehousing, data migrations, and the application of machine learning.

We are a Google Cloud partner. However, we work with other major cloud platforms.

Benefits

Health benefits, including medical, dental, and vision coverage.

Subsidy for certifications.

Subsidies for home-office equipment.

Assistance for fitness plans.

We encourage applications from people who look, feel, and think differently than members of our current team. We value candidates with non-linear career paths, and people who find themselves underrepresented or underestimated, especially in technical spaces.

We encourage applications from people with caregiving responsibilities.

21 hours ago
Related jobs
Promoted
Bitstrapped
Ontario, Canada

Implement data engineering technologies, primarily stream and batch processing systems with Apache Beam/Dataflow, Data Warehouses including BigQuery, queuing and message systems with Pub/Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL and Postgres, Redis, and Comp...

Deloitte
Toronto, Ontario

The data governance and data quality engineer is an individual contributor that provides specialized technical and functional expertise that works in collaboration with functional teams and stakeholders to modeling, developing, enhancing and deploying technical components related to the data governa...

Faire
Toronto, Ontario

Are you passionate about using data to shape the future of Faire's product features for small and medium businesses (SMBs)? If so, we want to talk to you! We're looking for a Senior Data Engineer with a deep expertise in designing and building data systems and a dedication to applying software devel...

GFL Environmental
Vaughan, Ontario

We are seeking a Senior Data Engineer with specialized experience in Data Lakehouse and AWS technologies to design, develop, and optimize our data management systems. Solid background in data engineering practices, including data modeling, ETL development, and data warehousing. The ideal candidate w...

Company 1 - The Manufacturers Life Insurance Company
Toronto, Ontario

You will contribute to the development and implementation of data pipelines and ETL processes to extract, transform, and load data into Manulife's data warehouse and utilize your expertise in building pipelines using, Python, Azure Data Factory, Databricks, Synapse, SQL server, and Azure functions t...

Moneris
Toronto, Ontario

Do you have experience building data pipelines and transforming raw data into relevant insights? Are you an expert in Snowflake development, with an understanding of cloud platforms and big data tools? If so, we want to hear from you!. We are looking for a Senior Data Engineer to join our growing te...

Doximity
Remote, Canada
Remote

Collaborate with product managers, data analysts, and machine learning engineers to develop pipelines and ETL tasks in order to facilitate the extraction of insights. You have developed maintainable data pipelines with them. You are experienced in creating automated testing, applying design patterns...

Astra North Infoteck Inc.
Toronto, Ontario

Kubernetes Clusters, Cloud, Data Analytics, CEPH. Kubernetes, Docker, Ansible, HELM, Bitbucket,Jfrog, Airflow, CI/CD, Data and Analytics tech, Grafana. ...

Deloitte
Toronto, Ontario

The data governance and data quality engineer is an individual contributor that provides specialized technical and functional expertise that works in collaboration with functional teams and stakeholders to modeling, developing, enhancing and deploying technical components related to the data governa...

S.i. Systems
Toronto, Ontario
Remote

X Senior Data Engineer to build data solutions and migrate SSIS packages from legacy systems to MuleSoft. ...