Data Engineering Lead and Data EngineersAlltech Consulting Services • Ottawa, ON, CA
Les candidatures ne sont plus acceptées
Data Engineering Lead and Data Engineers
Alltech Consulting Services • Ottawa, ON, CA
Il y a 15 jours
Type de contrat
- Temps plein
Description de posteBuild and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling. Proficient in developing programs in Python and SQL Experience with Data warehouse Dimensional data modeling. Working with event based / streaming technologies to ingest and process data. Working with structured, semi structured and unstructured data. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions. Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process. Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards. 5+ years Python coding experience. 5+ years – SQL Server based development of large datasets 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark. Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake. Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling. Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills. Experience with Cloud based data architectures, messaging, and analytics. Cloud certification(s). Strong experience in Code Optimizations and Performance tuning
Job Description
Must Have
- Snowflake
- Databricks
- SQL
- Python
- ADF
- PySpark
- Data Warehouse Concepts
Job Description
This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise in understanding Banking and Capital markets , especially in investment banking would be a big plus. Strong Database fundamentals is a must along with PySpark Coding expertise.
Major Responsibilities
Skills
#J-18808-Ljbffr
Créer une alerte emploi pour cette recherche
Lead Data Engineer • Ottawa, ON, CA
Offres similaires
We are seeking a highly experienced Senior ASIC Design Engineer to join a high-performance hardware development team.This role involves end-to-end ASIC design, from micro-architecture definition th...Voir plus
A leading technology firm in Canada seeks a Sr Principal Digital Verification Engineer to lead a team of up to 15 engineers.
This role involves developing complex verification environments and manag...Voir plus
A global survey platform is seeking an experienced Data Scientist to lead projects and mentor junior team members.You will advocate for data-driven practices while collaborating across teams.Requir...Voir plus
Resource Innovations is a women‑led energy transformation firm focused on impact.We provide empirically based research and program evaluations to support energy efficiency programs and energy trans...Voir plus
ASIC Digital Design, Senior Staff Engineer - 13121.Be among the first 25 applicants.At Synopsys, we drive the innovations that shape the way we live and connect.
Our technology is central to the Era...Voir plus
At Synopsys, we drive the innovations that shape the way we live and connect.Our technology is central to the Era of Pervasive Intelligence, from self-driving cars to learning machines.We lead in c...Voir plus
BioIntelligence Technologies started with a simple goal : accelerate access to greener chemicals for families, friends, citizens, and the planet.
Today, biotech accounts for 20% of all molecules and ...Voir plus At Synopsys, we drive the innovations that shape the way we live and connect.Our technology is central to the Era of Pervasive Intelligence, from self-driving cars to learning machines.We lead in c...Voir plus 
AdTech or MarTech environments.Strong experience with Adobe Analytics, including implementation, configuration, and reporting.
Proficiency in Adobe Experience Platform (AEP) and AEP Launch (Tags) fo...Voir plus
Headquartered in Ottawa, BTA Design serves the electronic design community from Canada, specializing in ASIC and FPGA design and verification, and embedded software development services.We augment ...Voir plus
We are seeking a highly experienced Senior ASIC Design Engineer to join a high-performance hardware development team.This role involves end-to-end ASIC design, from micro-architecture definition th...Voir plus
A leading semiconductor firm located in Ottawa is searching for a Senior ASIC Design Engineer.The role requires a minimum of 8 years in ASIC design with strong skills in RTL logic and lab troublesh...Voir plus AdTech or MarTech environments.Strong experience with Adobe Analytics, including implementation, configuration, and reporting.
Proficiency in Adobe Experience Platform (AEP) and AEP Launch (Tags) fo...Voir plus Headquartered in Ottawa, BTA Design serves the electronic design community from Canada, specializing in ASIC and FPGA design and verification, and embedded software development services.We augment ...Voir plus 
A design services company in Ottawa is seeking an experienced ASIC Design Engineer.You will be responsible for developing and integrating code while collaborating with systems engineers on architec...Voir plus Sr Principal Digital Verification Engineer.At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.
This is an opportunity to join a dynamic and ...Voir plus 
Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI.
We are the trusted analytics partner for multiple ...Voir plus A leading design services firm in Ottawa is seeking a Senior ASIC Design Engineer to join their team.This role involves translating system-level requirements into architecture, developing synthesis...Voir plus
ASIC Design Engineer (34680)
Myticas LLC • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 21 jours • Offre sponsorisée
Senior Principal Digital Verification Leader
Cadence • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
Senior ML Engineer & Tech Lead — NLP, MLOps, Mentoring
SurveyMonkey • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 23 heures • Offre sponsorisée
DSM Research and Evaluation Lead
Resource Innovations • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 21 jours • Offre sponsorisée
ASIC Digital Design, Senior Staff Engineer - 13121
Synopsys Inc • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
ASIC Digital Design, Senior Staff Engineer - 13121
Synopsys, Inc. • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 7 jours • Offre sponsorisée
Customer Success Engineer - BioIntelligence Technologies
BioIntelligence Technologies • gatineau, qc, ca
Temps plein
Dernière mise à jour : il y a 26 jours • Offre sponsorisée
ASIC Digital Design, Sr Staff Engineer - 13027
Synopsys, Inc. • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
Senior Digital Analytics Analyst
Maverick InnoGarage • gatineau, qc, ca
Temps plein
Dernière mise à jour : il y a 7 heures • Offre sponsorisée • Nouvelle offre
Senior ASIC Design Engineer
BTA Design Services • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 5 jours • Offre sponsorisée
ASIC Design Engineer
Myticas Consulting • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 5 jours • Offre sponsorisée
Senior ASIC Design Engineer for AI / HPC SoCs
Btadesignservices • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 4 jours • Offre sponsorisée
Senior Digital Analytics Analyst - Maverick InnoGarage
Maverick InnoGarage • ottawa, on, ca
Temps plein
Dernière mise à jour : il y a 7 heures • Offre sponsorisée • Nouvelle offre
Senior ASIC Design Engineer
Btadesignservices • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 4 jours • Offre sponsorisée
Senior ASIC Design Engineer - Innovate in Digital Silicon
High Tech Genesis • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 18 jours • Offre sponsorisée
Senior Principal Verification Engineer
Cadence • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
Data Engineer - AWS
Tiger Analytics Inc. • Ottawa, ON, CA
Télétravail
Temps plein
Quick Apply
Dernière mise à jour : il y a plus de 30 jours
Senior ASIC Design Engineer for AI / HPC SoCs
BTA Design Services • Ottawa, ON, Canada
Temps plein
Dernière mise à jour : il y a 5 jours • Offre sponsorisée