- Search jobs
- North Bay, ON
- big data engineer
Big data engineer Jobs in North Bay, ON
Advanced Data Engineer
Innova software Services IncON, Canada- Promoted
Senior Data Engineer
WELL Health Technologies Corp. (TSX : WELL)Ontario, Canada- Promoted
Staff Engineer with Waste Management
MastekOntario, Canada- Promoted
Data Network Consultant
AvanciersOntario, Canada, CanadaSenior Backend Software Engineer
RocheOntario, Ontario, Canada- Promoted
- New!
Pharmacy Data Specialist
Medisystem Pharmacy LimitedON, CanadaData Intern
LumerateOntario, CanadaSenior Software Engineer, Secure Compute
Confluent, IncOntario, Canada- Promoted
Research Engineer
Icspi CorporationON, Canadaadministrator, data
Conseil scolaire public du Nord-Est de l'OntarioNorth Bay, ON, CA- Promoted
Lead Data Engineer
First DerivativeOntario, Canada, Canada- Promoted
- New!
Senior Software Engineer, Data Platform
ThumbtackON, Canada- Promoted
Sr Python Engineer
SPECTRAFORCEOntario, Canada, Canadadata modeler
Falconridge Oil Ltd.ON, CA- Promoted
Senior Business Analyst (OTC)
Open Systems TechnologiesOntario, Canada- Promoted
Senior Data Engineer
BitstrappedOntario, Canada, CanadaData Engineer - Business Systems
HalffAny Location- Promoted
- New!
Senior Software Engineer
Ontario HealthON, CanadaSenior Software Engineer - Ads Bidding & Pacing
redditRemote, Ontario, CanadaData Modeler
ShoreWise ConsultingOntario, CAAdvanced Data Engineer
Innova software Services IncON, Canada- Full-time
- Quick Apply
Role : Advanced Data Engineer
Location : Canada (Remote)
Hire Type : Fulltime
Skill : Vertex AI
Job Description
As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will involve collaboration with cross-functional teams, leveraging cutting-edge technologies, and ensuring scalable, efficient, and secure data engineering practices. A strong emphasis will be placed on expertise in GCP, Vertex AI, and advanced feature engineering techniques.
Requirements
4+ years of professional Data Development experience.
4+ years of experience with SQL and NoSQL technologies.
3+ years of experience building and maintaining data pipelines and workflows.
5+ years of experience developing with Java.
2+ years of experience developing with Python.
3+ years of experience developing Kafka solutions.
2+ years of experience in feature engineering for machine learning pipelines.
Experience with GCP services such as BigQuery, Vertex AI Platform, Cloud Storage, AutoMLOps, and Dataflow.
Experience with CI / CD pipelines and processes.
Experience with automated unit, integration, and performance testing.
Experience with version control software such as Git.
Full understanding of ETL and Data Warehousing concepts.
Strong understanding of Agile principles (Scrum).
Additional Qualifications
Knowledge of Structured Streaming (Spark, Kafka, EventHub, or similar technologies).
Experience with GitHub SaaS / GitHub Actions.
Experience understanding Databricks concepts.
Experience with PySpark and Spark development.