Lead the migration from Glue/Redshift to Databricks
10+ years of professional data engineering experience, with at least 2+ years in a tech-lead or lead engineer capacity.
5-6 years of experience in each of the following areas:
Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file sizing).
Hands-on production experience with Databricks — Delta Lake, Unity Catalog, Workflows, and either Delta Live Tables or a comparable declarative pipeline framework.
Strong production experience with AWS Glue (jobs, crawlers, Data Catalog, triggers) and Amazon Redshift(including Redshift Spectrum, workload management, distribution and sort keys, performance tuning, and Redshift SQL / stored procedures).
Proven experience leading at least one substantial data platform migration or re-platforming effort end-to-end.
Expert SQL skills and strong software-engineering fundamentals: Python, version control, testing, and CI/CD.
Deep knowledge of AWS data services (S3, IAM, KMS, VPC, Lambda, Step Functions, MSK/Kinesis, CloudWatch).
Strong understanding of data modeling for analytics (dimensional, Data Vault, or medallion patterns) and lakehouse architecture.
Excellent communication skills; able to translate between executive stakeholders and engineers, and to write clear design docs and migration plans.
Data Engineer - Minimum 12+ years experience - québec city • québec city, qc, ca
Une entreprise de technologie audiovisuelle à Toronto recherche un développeur logiciel Passionné par les nouvelles technologies.Vous aurez la responsabilité de concevoir et développer des fonction... Show more
A forward-thinking tech company in Winnipeg is seeking a Senior Data Engineer to design and build scalable data systems.The role requires 8-10 years in SQL environments and expertise in data integr... Show more
No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more
Take on a dynamic role as a Senior Data Engineer in a remote-first environment dedicated to global data innovation and analytics.This position is crucial for designing modern data pipelines and opt... Show more
Une société technologique spécialisée cherche un(e) développeur(se) backend pour le développement de services et de pipelines d’intégration de données.Ce rôle inclut la collecte, transformation et ... Show more
LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage... Show more
At Borrowell, we're on a mission to help Canadians feel confident about their money.We empower individuals to take control of their financial futures by providing the tools and insights needed to u... Show more
At Neon One, we believe that technology is the key to building vibrant communities of generosity.As a leader in nonprofit software since 2004, we create intuitive solutions that help small and mid-... Show more
Generative AI Developer (Retail/CPG).Seeking a GenAI Developer with expertise in LLMs, RAG, and prompt engineering.Build scalable AI solutions using Python, LangChain, HuggingFace, and vector DBs l... Show more
Client: Enterprise class EMR provider.On behalf of our client, Affinity is seeking a DevOps Engineer to build and evolve the infrastructure behind its flagship EMR platform.You’ll own Kubernetes-ba... Show more
Design and implement robust dimensional and relational data models.Own transformation and modeling of curated (Silver/Gold) datasets.Collaborate with analysts, product analytics, data scientists, a... Show more
Get AI-powered advice on this job and more exclusive features.About US: We are a company that provides innovative, transformative IT services and solutions.We are passionate about helping our clien... Show more
A data-focused SaaS company in Canada seeks a Data Engineer to develop robust ETL pipelines, transform chaotic data into insights, and design effective data warehouse schemas.The role requires 5+ y... Show more
Navacord is hiring technical talent in the insurance industry! We are accepting applications for a dynamic individual with 5+ years experience in a full stack development environment and with at le... Show more
Launch Potato is a profitable digital media company that reaches over 30M+ monthly visitors through brands such as FinanceBuzz, All About Cookies, and OnlyInYourState.As The Discovery and Conversio... Show more
As part of the Operations team, this.CAD/CAM and MES/ERP solutions).This includes supporting the full software lifecycle: from implementation and user training to incident resolution.Consult, speci... Show more
As part of Diabsolut’s continued growth, we are expanding our Innovation team with an experienced.It is not a delivery role, a utilization role, or a presales capacity role.It exists so that Diabso... Show more
A data solutions company is seeking a Senior Data Developer to build and maintain the technical backbone of its analytics platform.This role requires deep expertise in dbt and Looker, with responsi... Show more
