Data Engineer (Vertica OR Snowflake & Airflow OR Spark)

Intelliswift Software
Canada, Canada
$60K a year (estimated)
Full-time

Must Have skills : Vertica OR SnowflakeAirflow OR SparkKubernetesJD : Experience with OLAP databases such as Vertica and or Snowflake.

Familiarity with data pipelines that use Airflow and Spark or equivalent tools. Familiarity with Kubernetes or other virtual environments.

Job responsibilities include : Regular monitoring of close to 100 jobs and fix enhancements History Load. Regular monitoring of Cluster performance and dashboard performance creating system alerts.

Vertica cluster set up; ACL set up; load testing and performance tuning. Creating Vertica Snowflake data pipeline jobs in UAT and Prod using ETL framework.

On-board NRT data pipeline as per business requirement Performance tuning of bad performing queries and data model redesign.

Designing the Database tables as per the requirements.

10 days ago
Related jobs
Promoted
Intelliswift Software
Canada

Experience with OLAP databases such as Vertica and or Snowflake. Familiarity with data pipelines that use Airflow and Spark or equivalent tools. Creating Vertica Snowflake data pipeline jobs in UAT and Prod using ETL framework. On-board NRT data pipeline as per business requirement Performance tunin...

Promoted
Intelliswift Software
Canada, Canada

Must Have skills:Vertica OR SnowflakeAirflow OR SparkKubernetesJD:Experience with OLAP databases such as Vertica and or Snowflake. Familiarity with data pipelines that use Airflow and Spark or equivalent tools. Creating Vertica Snowflake data pipeline jobs in UAT and Prod using ETL framework. On-boa...

ClickUp
Canada

We don’t care where you’re from, what you look like, or who you’re in a relationship with—we hire the best people for the job, and create an environment that supports employees on their journey to do the most exciting work of their lives! ClickUp is an Equal Opportunity Employer, and qualified appli...

Promoted
Clearco
Canada

Discovering data sources, getting data access, and cleaning data. The Senior Data Scientist will have the opportunity define and lead technical activities in the creation of models, building of advanced analytics, and leveraging machine learning. Mentoring other data scientists to level up capabilit...

Promoted
Evalueserve
Canada

Job Title: Principal Consultant – Marketing Data Scientist. Work directly with one of our clients, a major retail firm, to assist with their marketing analytics and data science initiatives. Utilize marketing analytics and data science techniques to discover key insights and deliver actionable recom...

Promoted
TekStaff IT Solutions
Canada

Candidate Requirements/Must-Have skills:.Chatbots/AI training, and familiarity with Generative AI.Familiarity with other Cloud platforms such as AWS, Azure, etc.Previous coding experience with Python and SQL.Good understanding of Machine Learning and Natural Language Processing (NLP).Previous contac...

Promoted
mode40
Canada

Intermediate level Software Developer. Develop information systems by designing, developing, and installing software solutions following the software development lifecycle. Provide mentorship to Junior and Intermediate software developers. In your role you will research, design, implement, manage, a...

Promoted
Inworld AI
Canada

DevOps, Infrastructure, Operations, or Site Reliability Engineer (or as a software engineer with relevant experience). We are looking for a Staff Cloud DevOps/Site Reliability Engineer to join our team. Our Technical Operations team manages the infrastructure, DevOps, and Site Reliability of our pla...

Promoted
AdventInfotech
Canada

The Data Scientist will play a crucial role in turning complex data into actionable insights that drive business decisions and innovation. We are seeking a highly motivated and skilled Data Scientist to join our dynamic team. Previous industry experience in a data scientist or analytics role. This p...

Promoted
Intelliswift Software
Canada

Software Developer- Data Engineering Background. ...