Talent.com
Cogency
Big Data Developer - CogencyCogency • oshawa, on, ca
Les candidatures ne sont plus acceptées
Big Data Developer - Cogency

Big Data Developer - Cogency

Cogency • oshawa, on, ca
Il y a 4 jours
Type de contrat
  • Temps plein
Description de poste

Job Title: Big Data Developer (Spark, AWS, Airflow, Snowflake, Big Data & ETL)


Company: Cogency Inc.


Location: Greater Toronto Area (Hybrid - 4 days office)


Job Summary

We are seeking a skilled and detail-oriented Data Engineer with strong expertise in Snowflake, Big Data technologies, and ETL processes. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and ensuring high data quality, performance, and security across the will work in an Agile environment, collaborating with cross-functional teams to deliver robust data solutions that support analytics, reporting, and business intelligence initiatives.


Key Responsibilities

  • Design, develop, and maintain data ingestion pipelines and ETL workflows
  • Build and optimize data pipelines, frameworks, and transformation processes
  • Ensure data quality, integrity, security, and performance across systems
  • Develop and optimize SQL queries, stored procedures, and data models
  • Integrate Snowflake with various data sources and BI/reporting tools
  • Monitor, troubleshoot, and resolve data pipeline and platform issues
  • Collaborate with cross-functional teams in an Agile delivery environment
  • Maintain comprehensive documentation for pipelines, transformations, and data models
  • Implement best practices in DevSecOps, CI/CD, and data engineering standards


Required Skills & Experience

  • 5+ years of experience in Data Engineering / ETL development
  • Strong hands-on experience with Big Data technologies:
  • Hadoop
  • Spark
  • Hive
  • Solid experience working with Snowflake data platform
  • Strong expertise in SQL and data modeling concepts
  • Programming experience in Scala or Java, including API development
  • Experience with ETL tools such as:
  • Informatica
  • Talend
  • Apache Airflow
  • Familiarity with cloud platforms (preferably AWS)
  • Understanding of DevSecOps practices, CI/CD pipelines, and Infrastructure-as-Code
  • Knowledge of GenAI tools for code generation and developer productivity enhancement
  • Excellent problem-solving, analytical, and communication skills


Preferred / Nice-to-Have Skills

  • Experience with AWS services (e.g., Glue, S3, Lambda)
  • Hands-on experience with Apache Airflow or similar workflow orchestration tools
  • Experience with CI/CD tools (GitHub Actions, Git, automated testing tools)
  • Exposure to containerization technologies (Docker, Kubernetes, OpenShift)
  • Knowledge of Python or scripting languages
  • Experience with shell scripting


Education

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field


Key Competencies

  • Strong analytical and problem-solving mindset
  • Ability to work independently and in team environments
  • Excellent communication and stakeholder collaboration skills
  • Attention to detail and commitment to data quality

Créer une alerte emploi pour cette recherche

Big Data Developer - Cogency • oshawa, on, ca

Offres similaires

Data Analyst - oshawa

BET99oshawa, on, ca
Temps plein

BET99 is Canada's Premiere Online Sportsbook and Casino.Launched in 2020, we have consistently innovated the online gaming landscape every step of the way, exponentially growing our customer base a... Voir plus

 • Offre sponsorisée

Senior Clinical Data Manager

Warman O'Brienoshawa, on, ca
Temps plein

Senior Clinical Data Manager | Small CRO | Full Time | Remote, Canada.Our client is a well-established Small CRO based in the Toronto Area and known for providing top-notch clinical solutions to a ... Voir plus

 • Offre sponsorisée

Développeur principal – Qualité des données (Collibra Data Quality) - Astek

Astekoshawa, on, ca
Temps plein

Astek est un leader mondial en conseil technologique, avec plus de 7 800 experts à travers le monde.Nous accompagnons nos clients dans leur transformation numérique en développant des solutions inn... Voir plus

 • Offre sponsorisée

Online Survey Participant: Work Remote and Earn Up To $25 Per Survey

Earn HausBrock, ON, CA
Télétravail
Temps plein +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Voir plus

 • Offre sponsorisée

Data Foundations Principal - Diabsolut

Diabsolutoshawa, on, ca
Temps plein

As part of Diabsolut’s continued growth, we are expanding our Innovation team with an experienced.It is not a delivery role, a utilization role, or a presales capacity role.It exists so that Diabso... Voir plus

 • Offre sponsorisée

Senior Statistical Programmer

Warman O'Brienoshawa, on, ca
Temps plein

Senior Statistical Programmer | Leading CRO | Remote – Canada |.Join a fast-growing, independent CRO recognised for high-quality deliverables, outstanding client service, and a flexible, entreprene... Voir plus

 • Offre sponsorisée

Senior API and Middleware Developer - Coforge

Coforgeoshawa, on, ca
Temps plein

Job Title/Role: API Middleware Developer.We at Coforge are seeking a API Middleware Developer with the following skillset:.As a Senior API & Middleware Developer for the Platform Engineering team, ... Voir plus

 • Offre sponsorisée

Senior API and Middleware Developer

Coforgeoshawa, on, ca
Temps plein

Job Title/Role: API Middleware Developer.We at Coforge are seeking a API Middleware Developer with the following skillset:.As a Senior API & Middleware Developer for the Platform Engineering team, ... Voir plus

 • Offre sponsorisée

Senior Clinical Data Manager - oshawa

Warman O'Brienoshawa, on, ca
Temps plein

Senior Clinical Data Manager | Small CRO | Full Time | Remote, Canada.Our client is a well-established Small CRO based in the Toronto Area and known for providing top-notch clinical solutions to a ... Voir plus

 • Offre sponsorisée

Data Engineer - Minimum 12+ years experience

NLB Servicesoshawa, on, ca
Temps plein

Lead the migration from Glue/Redshift to Databricks.Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file si... Voir plus

 • Offre sponsorisée

Data Engineer - Minimum 12+ years experience - oshawa

NLB Servicesoshawa, on, ca
Temps plein

Lead the migration from Glue/Redshift to Databricks.Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file si... Voir plus

 • Offre sponsorisée

Statistics Private Tutoring Jobs Beaverton

SuperprofBeaverton, Canada
20,00 $CA par heure
Temps plein +1

Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi... Voir plus

 • Offre sponsorisée

Azure & Databricks Data Engineer - Hybrid Contract

2iSolutions Inc.Oshawa, Durham Region, CA
Temps plein

A technology solutions provider is seeking 2 Data Engineers to join their team in Oshawa.The roles are 1-year contracts requiring expertise in Microsoft technologies, particularly Azure and Databri... Voir plus

 • Offre sponsorisée

Lead Data & AI Governance Analyst

Ontario Power Generation Inc.Oshawa, Durham Region, CA
Temps plein

Year University education in Information Governance, Data Management, Computer Science, or a related field.Ontario Power Generation (OPG) is looking for a dynamic, strategic and results-driven prof... Voir plus

 • Offre sponsorisée

Data Analyst

BET99oshawa, on, ca
Temps plein

BET99 is Canada's Premiere Online Sportsbook and Casino.Launched in 2020, we have consistently innovated the online gaming landscape every step of the way, exponentially growing our customer base a... Voir plus

 • Offre sponsorisée

Guidewire Developer/Tech Lead

Delta System & Software, Inc.oshawa, on, ca
Temps plein

Job Title: Guidewire Tech Lead.Must have: Guidewire ACE Certification.Strong hands-on experience in PolicyCenter, BillingCenter, or ClaimCenter (v10.Lead and mentor a team of developers, driving de... Voir plus

 • Offre sponsorisée

Fall 2026 - Co-Op/Development - Data Analytics - Durham Region

Ontario Power Generation Inc.Pickering, ON, CA
Temps plein

Fall 2026 - Co-Op/Development - Data Analytics - Durham Region.Contribute to real‑world projects that align with your field of study and career interests.Collaborate with cross‑functional teams to ... Voir plus

 • Offre sponsorisée

Data Analyst - BET99

BET99oshawa, on, ca
Temps plein

BET99 is Canada's Premiere Online Sportsbook and Casino.Launched in 2020, we have consistently innovated the online gaming landscape every step of the way, exponentially growing our customer base a... Voir plus

 • Offre sponsorisée

Data Foundations Principal

Diabsolutoshawa, on, ca
Temps plein

As part of Diabsolut’s continued growth, we are expanding our Innovation team with an experienced.It is not a delivery role, a utilization role, or a presales capacity role.It exists so that Diabso... Voir plus

 • Offre sponsorisée

Data Engineer - Minimum 12+ years experience - NLB Services

NLB Servicesoshawa, on, ca
Temps plein

Lead the migration from Glue/Redshift to Databricks.Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file si... Voir plus