Talent.com
Senior Data Engineer

Senior Data Engineer

BitstrappedOntario, Canada
16 days ago
Job type
  • Full-time
Job description

We are seeking a hands-on Senior Data Engineer in a full-time salaried position. The Sr. Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams.

The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a hands-on consultant to our customers. The Data Engineer will work mostly on Google Cloud, interacting with other platforms such as AWS or Microsoft Azure in hybrid environments.

Responsibilities

  • Design, implement, automate, and maintain enterprise data systems for our customers
  • Implement data engineering technologies, primarily stream and batch processing systems with Apache Beam / Dataflow, Data Warehouses including BigQuery, queuing and message systems with Pub / Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL and Postgres, Redis, and Composer DAG-based workflow automation
  • Show an ability to implement data system robustness including caches, clustering, partitioning, event windows, performant and cost efficient data warehouse queries, audit tables, data governance and security including RBAC and CBAC
  • Capable of balancing 1-2 client projects with differing project priorities
  • Write reusable and scalable code, prioritizing a test driven approach where possible
  • Experience working with project plans and milestone based sprints, under the supervision of technical project management and principal architects
  • Hands-on experience with relational and non-relational databases, as well as file types that include Parquet, Avro, csv
  • Strong verbal communication skills
  • Possess a desire to continuously learn and adopt new technologies
  • Possess a desire to work in a fast paced environment
  • Be capable of working independently, staying on task, and remaining productive with little supervision

Minimum Requirements

  • 5+ years experience as a data engineer or software engineer in a professional environment
  • 5+ years of experience with data engineering duties including data ingestion, data processing, ETL / ELT, parallel computing, integration of sinks / taps, workflow orchestration
  • Strong knowledge of databases and data storage
  • Ability to architect, develop, and test code at an enterprise level, adhering to software engineering best practices
  • Ability to Design data models with a strong understanding of modeling design patterns.
  • Proficiency in at least one programming language.
  • Has knowledge and experience working on distributed systems (monitoring, alerting, message contracts)
  • Cloud Certifications - GCP Data Engineer certification preferred
  • Bonus

  • Experience in Data Science and Data Science Engineering
  • Experience with the deployment of workloads to the cloud
  • Experience interacting with other cloud infrastructure services including Cloud Functions, Kubernetes, or VertexAI is a nice to have
  • Experience with DevOps CI / CD workflows using technologies such as Github, Gitlab, Jenkins, CircleCI, Bitbucket, and otherDevOps Technologies.
  • Experience writing infrastructure as code using Terraform
  • About Bitstrapped

    Bitstrapped is a fast-growing consulting firm with Data and AI services practices. Our passion lies in our ability to help companies invest in forward-thinking data-to-AI infrastructure. Investments in these areas enable our customers to distinguish their brands from their competition, stay competitive, and produce better business outcomes.

    We help our customers architect solutions for the cloud, advanced data engineering, MLOps, and AI infrastructure. This includes engineering systems for data ingestion, data transformation, data warehousing, data migrations, and the application of machine learning. We are a Google Cloud partner. However, we work with other major cloud platforms.

    Benefits

    Health benefits, including medical, dental, and vision coverage.

    Subsidy for certifications.

    Subsidies for home-office equipment.

    Assistance for fitness plans.

    We encourage applications from people who look, feel, and think differently than members of our current team. We value candidates with non-linear career paths, and people who find themselves underrepresented or underestimated, especially in technical spaces. We encourage applications from people with caregiving responsibilities.