Talent.com
Cogency
Big Data Developer - CogencyCogency • oshawa, on, ca
Big Data Developer - Cogency

Big Data Developer - Cogency

Cogency • oshawa, on, ca
14 hours ago
Job type
  • Full-time
Job description

Job Title: Big Data Developer (Spark, AWS, Airflow, Snowflake, Big Data & ETL)


Company: Cogency Inc.


Location: Greater Toronto Area (Hybrid - 4 days office)


Job Summary

We are seeking a skilled and detail-oriented Data Engineer with strong expertise in Snowflake, Big Data technologies, and ETL processes. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and ensuring high data quality, performance, and security across the will work in an Agile environment, collaborating with cross-functional teams to deliver robust data solutions that support analytics, reporting, and business intelligence initiatives.


Key Responsibilities

  • Design, develop, and maintain data ingestion pipelines and ETL workflows
  • Build and optimize data pipelines, frameworks, and transformation processes
  • Ensure data quality, integrity, security, and performance across systems
  • Develop and optimize SQL queries, stored procedures, and data models
  • Integrate Snowflake with various data sources and BI/reporting tools
  • Monitor, troubleshoot, and resolve data pipeline and platform issues
  • Collaborate with cross-functional teams in an Agile delivery environment
  • Maintain comprehensive documentation for pipelines, transformations, and data models
  • Implement best practices in DevSecOps, CI/CD, and data engineering standards


Required Skills & Experience

  • 5+ years of experience in Data Engineering / ETL development
  • Strong hands-on experience with Big Data technologies:
  • Hadoop
  • Spark
  • Hive
  • Solid experience working with Snowflake data platform
  • Strong expertise in SQL and data modeling concepts
  • Programming experience in Scala or Java, including API development
  • Experience with ETL tools such as:
  • Informatica
  • Talend
  • Apache Airflow
  • Familiarity with cloud platforms (preferably AWS)
  • Understanding of DevSecOps practices, CI/CD pipelines, and Infrastructure-as-Code
  • Knowledge of GenAI tools for code generation and developer productivity enhancement
  • Excellent problem-solving, analytical, and communication skills


Preferred / Nice-to-Have Skills

  • Experience with AWS services (e.g., Glue, S3, Lambda)
  • Hands-on experience with Apache Airflow or similar workflow orchestration tools
  • Experience with CI/CD tools (GitHub Actions, Git, automated testing tools)
  • Exposure to containerization technologies (Docker, Kubernetes, OpenShift)
  • Knowledge of Python or scripting languages
  • Experience with shell scripting


Education

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field


Key Competencies

  • Strong analytical and problem-solving mindset
  • Ability to work independently and in team environments
  • Excellent communication and stakeholder collaboration skills
  • Attention to detail and commitment to data quality

Create a job alert for this search

Big Data Developer - Cogency • oshawa, on, ca

Similar jobs

Big Data Developer - oshawa

Cogencyoshawa, on, ca
Full-time

Big Data Developer (Spark, AWS, Airflow, Snowflake, Big Data & ETL).Greater Toronto Area (Hybrid - 4 days office).We are seeking a skilled and detail-oriented.Snowflake, Big Data technologies, and ... Show more

 • Promoted • New!

Senior Data Architect - GlobalVariable

GlobalVariableoshawa, on, ca
Full-time

Data Architect/Modeller - Senior.Experience with Identity and Access Management products or initiatives strongly preferred.Minimum 5 years of experience as a Data Architect, Data Specialist, or equ... Show more

 • Promoted • New!

Data Engineer

AMA Global Technology Incoshawa, on, ca
Full-time

Role: Data Engineer (Cloud Data Warehouse | SQL | Medallion Architecture).Location: Toronto, ON (Hybrid 3days onsite, 2days remote).Duration: 12 months with potential to extend.Medallion (Bronze/Si... Show more

 • Promoted • New!

Azure Data Engineer - Epsilon Solutions Ltd.

Epsilon Solutions Ltd.oshawa, on, ca
Full-time

Location: Toronto, ON (4 days onsite per week).Note: The L1 and L2 interview will be conducted in person at the client’s location.Strong understanding of semantic models used in enterprise reportin... Show more

 • Promoted • New!

Data Scientist - Delpath

Delpathoshawa, on, ca
Full-time

Data Scientist – Banking & Capital Calculations.Location Address: Hybrid - Toronto – 2 days/week (Mondays, Wednesdays).Subject to change: 3–4 days onsite may be required based on business needs.Con... Show more

 • Promoted • New!

Data Engineer - oshawa

AMA Global Technology Incoshawa, on, ca
Full-time

Role: Data Engineer (Cloud Data Warehouse | SQL | Medallion Architecture).Location: Toronto, ON (Hybrid 3days onsite, 2days remote).Duration: 12 months with potential to extend.Medallion (Bronze/Si... Show more

 • Promoted • New!

Senior Data Architect - StafinGo

StafinGooshawa, on, ca
Full-time

Hiring : Senior Data Architect / Data Modeller (Public Sector)-Ontario.Lead analysis and recommendations for.Assess current standards and identify modernization opportunities.Collaborate with solut... Show more

 • Promoted • New!

Data Foundations Principal - Diabsolut

Diabsolutoshawa, on, ca
Full-time

As part of Diabsolut’s continued growth, we are expanding our Innovation team with an experienced.It is not a delivery role, a utilization role, or a presales capacity role.It exists so that Diabso... Show more

 • Promoted

Big Data Developer – Data Platform (French Speaker) - Sky Systems, Inc. (SkySys)

Sky Systems, Inc. (SkySys)oshawa, on, ca
Full-time

Big Data Developer – Data Platform (French Speaker).Montreal (Downtown Montreal / Old Port Montreal) – Remote with 6 days/month onsite.Seeking an experienced Big Data Developer to design, develop, ... Show more

 • Promoted • New!

Data Engineer - Minimum 12+ years experience - oshawa

NLB Servicesoshawa, on, ca
Full-time

Lead the migration from Glue/Redshift to Databricks.Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file si... Show more

 • Promoted

Java & Hadoop Developer

Lorven Technologies Inc.oshawa, on, ca
Full-time

Location: Toronto, ON (4 days a week on site).Job Type: Job Type: Contract to Hire / Long-term contract.Kafka-based event-driven architectures.Strong understanding of micro services lifecycle: desi... Show more

 • Promoted • New!

Data Engineer - AMA Global Technology Inc

AMA Global Technology Incoshawa, on, ca
Full-time

Role: Data Engineer (Cloud Data Warehouse | SQL | Medallion Architecture).Location: Toronto, ON (Hybrid 3days onsite, 2days remote).Duration: 12 months with potential to extend.Medallion (Bronze/Si... Show more

 • Promoted • New!

Azure Data Engineer - oshawa

Epsilon Solutions Ltd.oshawa, on, ca
Full-time

Location: Toronto, ON (4 days onsite per week).Note: The L1 and L2 interview will be conducted in person at the client’s location.Strong understanding of semantic models used in enterprise reportin... Show more

 • Promoted • New!

Data Engineer - oshawa

Enterprise Solutions Inc.oshawa, on, ca
Full-time

Work Location : Mississauga-Ontario-CA- Onsite from day 1.Salary: CAD$85 k to CAD$90k/annum.Mandatory Skills : Apache Spark, Scala, Big Data Hadoop Ecosystem, Python, SparkSQL.Seeking a Specialist ... Show more

 • Promoted • New!

Big Data Developer

Cogencyoshawa, on, ca
Full-time

Big Data Developer (Spark, AWS, Airflow, Snowflake, Big Data & ETL).Greater Toronto Area (Hybrid - 4 days office).We are seeking a skilled and detail-oriented.Snowflake, Big Data technologies, and ... Show more

 • Promoted • New!

Big Data Developer – Data Platform (French Speaker) - oshawa

Sky Systems, Inc. (SkySys)oshawa, on, ca
Full-time

Big Data Developer – Data Platform (French Speaker).Montreal (Downtown Montreal / Old Port Montreal) – Remote with 6 days/month onsite.Seeking an experienced Big Data Developer to design, develop, ... Show more

 • Promoted • New!

Data Engineer - oshawa

Mphasisoshawa, on, ca
Full-time

Looking for a candidate from Data Scientist and Developer background, should have experience in Machine Learning and Snowflake.Should have experience on the following: -.Design, develop, and mainta... Show more

 • Promoted • New!

Big Data Developer – Data Platform (French Speaker)

Sky Systems, Inc. (SkySys)oshawa, on, ca
Full-time

Big Data Developer – Data Platform (French Speaker).Montreal (Downtown Montreal / Old Port Montreal) – Remote with 6 days/month onsite.Seeking an experienced Big Data Developer to design, develop, ... Show more