Job Title : Data Engineerwith Python DataBricks and Snowflake
Location : Montreal QC or Mississauga ONHybrid
No. of positions : 2
Exp : 814years
willing to relocate toMississauga or Montreal
Responsibilities
Handson development experience with Snowflake featuressuch as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel;
Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; andstored procedures.
- Experience in Datawarehousing OLTP OLAP Dimensions Facts and Datamodeling.
- Need to have working knowledge of MSAzure configuration items with respect to Snowflake.
- Developing EL pipelines in and out of data warehouseusing combination of Data bricks Python and Snow SQL.
- Strong understanding or Snowflake on Azure Architecturedesign implementation and operationalization of largescale data andanalytics solutions on Snowflake Cloud Data Warehouse.
- Developing scripts UNIX Python etc. to Extract Load andTransform data as well as other utility functions.
- Provide production support for Data Warehouse issues suchdata load problems transformation translation problems
- Translate mapping specifications to data transformationdesign and development strategies and code incorporating standardsand best practices for optimal execution.
- Understanding data pipelines and modern ways ofautomating data pipeline using cloudbased testing and clearlydocument implementations so others can easily understand therequirements implementation and test conditions.
- Perform code reviews to ensure fit to requirementsoptimal execution patterns and adherence to establishedstandards.
Requirements :
- Minimum 8 yearsof designing and implementing an operational production gradelargescale data solution on Microsoft Azure Snowflake DataWarehouse.
- Including hands on experience withproductionized data ingestion and processing pipelines using PythonData bricks Snow SQL
- Excellent understanding of Snowflake Internals andintegration of Snowflake with other data processing and reportingtechnologies
- Excellent presentation andcommunication skills both written and verbal ability to problemsolve and design in an environment with unclearrequirements.
Data Engineer (Vertica OR Snowflake & Airflow OR Spark)
Experience with OLAP databases such as Vertica and or Snowflake. Familiarity with data pipelines that use Airflow and Spark or equivalent tools. Creating Vertica Snowflake data pipeline jobs in UAT and Prod using ETL framework. On-board NRT data pipeline as per business requirement Performance tunin...
Data Engineer (Vertica OR Snowflake & Airflow OR Spark)
Must Have skills:Vertica OR SnowflakeAirflow OR SparkKubernetesJD:Experience with OLAP databases such as Vertica and or Snowflake. Familiarity with data pipelines that use Airflow and Spark or equivalent tools. Creating Vertica Snowflake data pipeline jobs in UAT and Prod using ETL framework. On-boa...
Jr Data Engineer with Python, Sql and Tableau experience to support data driven projects for our large telco client -19022
Jr Data Engineer with Python, Sql and Tableau experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. Basic und...
Senior Data Engineer- Snowflake
As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, data integration processes, and data infrastructure using Cloud Snowflake DBT. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure efficient data flow and su...
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -19021
Int Data Engineer with GCP, Python and SQL experience to support data driven projects for our large telco client -. As a Data Engineer, you will be responsible for designing, building and running the data driven applications which enable innovative, customer centric digital experiences. Basic unders...
Senior Azure Data Engineering Specialist -Databricks and Synapse
Are you an experienced Azure Data Engineering professional interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients? Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to creat...
Staff Engineer, Audiences & Customer Data Platform
You will work with large data sets and have exposure to modern tech stacks around GoLang, Ruby on Rails, React, GraphQL and more. Unpacks ambiguity and complexity with ease and is able to advise and delegate work as needed to deliver on greenfield initiatives. Collaborate with stakeholders and other...
Staff Software Engineer with Java (Springboot) to build out features on a Master Data Management product from start to finish.
Staff Software Engineer with Java (Springboot) to build out features on a Master Data Management product from start to finish. Experience with cloud development (. Experience with application development on. ...
Senior Kubernetes Engineer (with Python)
Hands-on experience in designing, developing and optimizing scalable, secure and reliable Python applications within a Kubernetes environment. Our client is looking to add a Senior Kubernetes Engineer to their team to engage with multiple development teams and stakeholders to define and deliver new ...
Machine Learning Engineer - Advanced Data and Analytics
You will work closely with a team of data scientists and data engineers to deploy solutions and drive innovation using machine learning and NLP techniques. The ideal candidate has a deep understanding of data analysis, Cloud engineering, machine learning, NLP techniques, along with a proven track re...