Lead the migration from Glue/Redshift to Databricks
10+ years of professional data engineering experience, with at least 2+ years in a tech-lead or lead engineer capacity.
5-6 years of experience in each of the following areas:
Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file sizing).
Hands-on production experience with Databricks — Delta Lake, Unity Catalog, Workflows, and either Delta Live Tables or a comparable declarative pipeline framework.
Strong production experience with AWS Glue (jobs, crawlers, Data Catalog, triggers) and Amazon Redshift(including Redshift Spectrum, workload management, distribution and sort keys, performance tuning, and Redshift SQL / stored procedures).
Proven experience leading at least one substantial data platform migration or re-platforming effort end-to-end.
Expert SQL skills and strong software-engineering fundamentals: Python, version control, testing, and CI/CD.
Deep knowledge of AWS data services (S3, IAM, KMS, VPC, Lambda, Step Functions, MSK/Kinesis, CloudWatch).
Strong understanding of data modeling for analytics (dimensional, Data Vault, or medallion patterns) and lakehouse architecture.
Excellent communication skills; able to translate between executive stakeholders and engineers, and to write clear design docs and migration plans.
Data Engineer - Minimum 12+ years experience • kingston, on, ca
Must be Eligible for Reliability Status.Gather, document, and analyze data and information management requirements.Work with stakeholders to translate business needs into data solutions and product... Show more
DevOps Engineer needed to support internal software applications, troubleshoot issues, and enhance ML model development. Show more
Develop sophisticated software using React, TypeScript, and Node.Collaborate with cross-functional teams and mentor junior developers. Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more
WSP is currently seeking an Engineer to join our Land Development and Municipal Engineering Team, located at our Kingston office.In this position will be responsible for the execution and review of... Show more
Join Huawei Canada as a Research Engineer focused on LLM evaluation and training systems within a 12-month contract.Lead the charge in research and prototyping for cutting-edge large-scale model de... Show more
Develops and maintains Power BI reports and data models, integrating data from various systems and ensuring data accuracy for manufacturing and supply chain operations. Show more
DLS Technology Corporation is seeking a highly skilled.CI/CD pipelines, cloud infrastructure, and automation frameworks.The ideal candidate possesses a strong background in Infrastructure as Code (... Show more
Headquartered in California, U.GSPANN is a leading provider of consulting and IT services to global clients.We specialize in helping clients transform their IT capabilities, optimize business pract... Show more
Headquartered in California, U.GSPANN is a leading provider of consulting and IT services to global clients.We specialize in helping clients transform their IT capabilities, optimize business pract... Show more
WSP is seeking an engineer to join our Land Development and Municipal Engineering Team at our Kingston office.The role focuses on local municipal and land development projects in Kingston and surro... Show more
Senior Data Engineers needed to build and maintain data pipelines and products within Microsoft Fabric and Azure ecosystems. Show more
We are seeking a highly skilled.BigQuery, PySpark, and Dataflow.The role involves working closely with analytics, product, and engineering teams to ensure reliable data availability and performance... Show more
Must be Eligible for Reliability Status.Gather, document, and analyze data and information management requirements.Work with stakeholders to translate business needs into data solutions and product... Show more
DLS Technology Corporation is seeking a highly skilled.CI/CD pipelines, cloud infrastructure, and automation frameworks.The ideal candidate possesses a strong background in Infrastructure as Code (... Show more
We’ve opened a role in our any of our offices for a talented, entrepreneurial Applications & Data Lead to work alongside exceptional people in JLR’s IT & Workspaces group.Do you bring a computer sc... Show more
What if you could redefine what’s possible? With us, you can.We are the home of ambitious, passionate, and innovative world shapers.With an unmatched breadth and depth of engineering, advisory and ... Show more
Join Huawei Canada as a Research Engineer focused on LLM evaluation and training systems within a 12-month contract.Lead the charge in research and prototyping for cutting-edge large-scale model de... Show more
We are seeking a highly skilled.BigQuery, PySpark, and Dataflow.The role involves working closely with analytics, product, and engineering teams to ensure reliable data availability and performance... Show more
Designs and scales backend platforms for financial and payment products.Drives projects from concept to production. Show more
