Data Engineering Lead and Data EngineersAlltech Consulting Services • Ottawa
Data Engineering Lead and Data Engineers
Alltech Consulting Services • Ottawa
Il y a plus de 30 jours
Type de contrat
- Temps plein
Description de posteBuild and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling. Proficient in developing programs in Python and SQL Experience with Data warehouse Dimensional data modeling. Working with event based / streaming technologies to ingest and process data. Working with structured, semi structured and unstructured data. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions. Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process. Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards. 5+ years Python coding experience. 5+ years – SQL Server based development of large datasets 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark. Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake. Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling. Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills. Experience with Cloud based data architectures, messaging, and analytics. Cloud certification(s). Strong experience in Code Optimizations and Performance tuning
Job Description
Must Have
- Snowflake
- Databricks
- SQL
- Python
- ADF
- PySpark
- Data Warehouse Concepts
Job Description :
This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise in understanding Banking and Capital markets , especially in investment banking would be a big plus. Strong Database fundamentals is a must along with PySpark Coding expertise.
Major Responsibilities :
Skills :
Créer une alerte emploi pour cette recherche
Data Engineering Lead and Data Engineers • Ottawa
Offres similaires
A global survey platform is seeking an experienced Data Scientist to lead projects and mentor junior team members.You will advocate for data-driven practices while collaborating across teams.Requir...Voir plus
Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).Must be able to...Voir plus
A leading survey platform is seeking a senior data science leader to guide and mentor junior team members while driving machine learning projects.
Candidates should have over 12 years of data scienc...Voir plus
A leading global consulting firm in Ottawa seeks a Manager - Solution Architect / Tech Lead to enhance client capabilities in data analytics.
This role involves supporting key projects, building inter...Voir plus
Connect with us to discover our latest job opportunities! Even if nothing suits you right now, stay in touch — your perfect role may be just around the corner! .
Noda is a data and analytics co...Voir plus
Our client, a leading organization in the public sector, is seeking a.As a SAP SuccessFactors Data Lead, you will be part of the HR and Data Management department supporting SAP HR modules.The idea...Voir plus
A leading analytics consulting firm in Ontario is seeking a skilled Data Engineer to architect and implement advanced analytics capabilities.
You will work with large data sets and visualization too...Voir plus Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).Must be able to...Voir plus 
We are hiring a Data Lead to support a large-scale enterprise transformation program delivering a modern Knowledge Management (KM) solution.
In this role, you will lead data-related activities that ...Voir plus
TekRek has partnered with a fast growing firm specializing in AI enablement and data optimization.Our client works with some of the top tier technology firms in Silcom Valley.With rapid growth and ...Voir plus
We Are • •Accenture Technology – is an exciting place to be! Accenture helps companies rotate to New IT with services that drive continuous quality and efficiency and shape their digital future.We of...Voir plus
A public service organization is seeking an experienced Database Architect for a future opportunity.This role focuses on leading assessments and modernizing the enterprise data ecosystem.Candidates...Voir plus
A leading technology firm in Ottawa is seeking a Software Engineering Manager to drive the next generation of digital forensics tools.
You will lead technical teams, establish modern AI practices in...Voir plus
As The Discovery and Conversion Company, our mission is to connect consumers with the world’s leading brands through data-driven content and technology.
Headquartered in South Florida with a remote-...Voir plus
A leading cybersecurity firm is seeking a Director of Engineering to lead its Email Archive portfolio, focusing on compliance and security.
The role involves guiding distributed teams, enhancing pro...Voir plus
Fujitsu Canada is seeking a full-time, permanent Content Migration Specialist to support enterprise-scale Knowledge Management (KM) modernization projects supporting on of our large Government of C...Voir plus
Senior Databricks Data Engineer.Location : In Toronto, Montreal, or Ottawa.Job Type : Full-time or Contract.Rate and salary : up to $100 per hour (contract), or up to $160,000 per year (employee).Seni...Voir plus
A leading design services firm in Ottawa is seeking a Senior ASIC Design Engineer with over 8 years of experience in ASIC design and complex RTL logic.
In this role, you will translate system-level ...Voir plus
Senior ML Engineer & Tech Lead — NLP, MLOps, Mentoring
SurveyMonkey • Ottawa H2B, ON, Canada
Télétravail
Temps plein
Dernière mise à jour : il y a 25 jours • Offre sponsorisée
AWS data engineer DWIDC5725169
Compunnel Inc. • ottawa, on, ca
Temps plein
Dernière mise à jour : il y a 2 jours • Offre sponsorisée
Senior Staff ML Engineer & Data Leadership (Hybrid)
Tree Trust • Ottawa
Temps plein
Dernière mise à jour : il y a 3 jours • Offre sponsorisée
AI & Data Leader : Solution Architect & Tech Lead
EY • Ottawa
Temps plein
Dernière mise à jour : il y a 18 jours • Offre sponsorisée
Data Engineer
Noda • Ottawa, Ontario, CA
Temps plein
Quick Apply
Dernière mise à jour : il y a 4 jours
SAP SuccessFactors Data Lead
Experis • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 7 jours • Offre sponsorisée
Data Engineer : Snowflake DW & ELT Visionary
Tiger Analytics • Ottawa
Temps plein
Dernière mise à jour : il y a 18 jours • Offre sponsorisée
AWS data engineer DWIDC5725169 - Compunnel Inc.
Compunnel Inc. • ottawa, on, ca
Temps plein
Dernière mise à jour : il y a 2 jours • Offre sponsorisée
Data Lead
CGI • Ottawa
Temps plein
Dernière mise à jour : il y a 6 jours • Offre sponsorisée
Senior Analytics Engineer
TekRek • ottawa, on, ca
Temps plein
Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
Data Centre Engineer
Queer Tech • Ottawa
Temps plein
Dernière mise à jour : il y a 6 jours • Offre sponsorisée
Remote Data Architect - Modernize Enterprise Data
Orangutech • Ottawa H2B, ON, Canada
Télétravail
Temps partiel
Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
Hybrid Software Engineering Manager — Lead AI‑Driven SaaS
Magnet Forensics • Ottawa H2B, ON, Canada
Télétravail
Temps plein
Dernière mise à jour : il y a 23 jours • Offre sponsorisée
Lead Data Engineer
Launch Potato • Ottawa
Temps plein
Dernière mise à jour : il y a 17 jours • Offre sponsorisée
Director of Engineering – Global Data & Compliance Platform
Barracuda Networks Inc. • Ottawa H2B, ON, Canada
Télétravail
Temps plein
Dernière mise à jour : il y a 23 jours • Offre sponsorisée
Development Lead
Fujitsu • Gatineau, QC, Canada
Temps plein +1
Dernière mise à jour : il y a 8 jours • Offre sponsorisée
Senior Databricks Data Engineer
KData AI • Toronto, Ottawa, Montreal (Administrative Region)
Temps plein
Dernière mise à jour : il y a 1 jour • Offre sponsorisée
Senior ASIC Design Engineer – AI / HPC SoCs & RTL Expert
BTA Design Services Inc. • Ottawa H2B, ON, Canada
Temps plein
Dernière mise à jour : il y a 23 jours • Offre sponsorisée