Talent.com

Big data engineer Jobs in Markham, ON

Create a job alert for this search

Big data engineer • markham on

Last updated: 1 day ago
Data Engineer

Data Engineer

Integrity AsiaMarkham, York Region, CA
Full-time
Get AI-powered advice on this job and more exclusive features.Are you a passionate data engineer ready to build the infrastructure that powers our insights and decisions? As a.Data Scientist team b...Show moreLast updated: 30+ days ago
Developer - Emerging technologies (Big Data, Mobile, Cloud, RPA) - 5

Developer - Emerging technologies (Big Data, Mobile, Cloud, RPA) - 5

LancesoftScarborough, ON, CA
Full-time
Quick Apply
Work arrangement : (Hybrid) 2 days in office –Wed and Fridays.Contract Duration : 3- 6 months will be renewed on a monthly basis due to changes in the funding source. Possibility of extension &a...Show moreLast updated: 1 day ago
Senior Data Engineer

Senior Data Engineer

Aarorn Technologies IncMarkham, York Region, CA
Full-time
Location : Markham, ON (3x onsite a week).Advocate for engineering standards and process efficiencies to ensure high‑quality, timely delivery. Lead the development of complex, high‑performance data p...Show moreLast updated: 3 days ago
Manager, Data Engineer

Manager, Data Engineer

ScotiabankScarborough, ON, CA
Full-time
Champion a customer focused culture to deepen client relationships and leverage broader Bank relationships, systems and knowledge. Design and maintain scalable data architecture in SQL Server (on-pr...Show moreLast updated: 15 days ago
Big Data Architect

Big Data Architect

BMO Financial GroupScarborough, ON
Temporary
BMO is an organization driven by a shared Purpose : Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show moreLast updated: 30+ days ago
Data Engineer

Data Engineer

Xplore Inc.Markham, York Region, CA
Full-time
Canada’s fibre, 5G and satellite broadband company for rural living.Xplore is committed to the relentless pursuit of an improved broadband experience for all Canadians. Xplore is building a world‑cl...Show moreLast updated: 8 days ago
Data Engineer

Data Engineer

Compunnel Inc.Markham, York Region, CA
Full-time
Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Compunnel Inc.University degree in Computer Engineering or Computer Science.Solid grasp / experience w...Show moreLast updated: 30+ days ago
Analytics Data Engineer

Analytics Data Engineer

Frontier Dental SupplyMarkham, Ontario, Canada
Full-time
Must be willing to work on-site in Markham office 5 days / week • •.Come work with us to do what you love and stay for the Frontier TRACK. We each take responsibility for fostering an environment of pe...Show moreLast updated: 30+ days ago
Data Engineer

Data Engineer

Quantum Management ServicesNorth York, ON (Hybrid
Temporary
North York, ON (Hybrid – on-site Monday–Thursday).This position will support large-scale retail and e-commerce data initiatives, working with complex datasets to deliver reliable, scalable, and hig...Show moreLast updated: 20 days ago
Database Research Expert - Big Data Platform

Database Research Expert - Big Data Platform

HuaweiMarkham, York Region, CA
Full-time
The Computing Data Application Acceleration Lab aims to create a leading global data analytics platform organized into three specialized teams using innovative programming technologies.This team fo...Show moreLast updated: 30+ days ago
Data Engineer & Analytics

Data Engineer & Analytics

Kredivo GroupMarkham, York Region, CA
Full-time
As a Data Engineer and Analytic you will be tasked with empowering internal stakeholders to delve deep into the complexities of the data in our warehouse. You will work closely with Product, Enginee...Show moreLast updated: 30+ days ago
Electrical Engineer (Data Center)

Electrical Engineer (Data Center)

Fashion Institute of Design & MerchandisingRichmond Hill, York Region, CA
Full-time
Electrical Engineer (Data Center) - (186630).At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected, a place where everyone is em...Show moreLast updated: 30+ days ago
Senior C++ Big Data Engineer - Systems & Algorithms

Senior C++ Big Data Engineer - Systems & Algorithms

Huawei Technologies Canada Co., Ltd.Markham, York Region, CA
Full-time
A global technology company in York Region, Markham is seeking a Senior Developer to analyze software requirements, contribute to software development, and mentor a team. The ideal candidate should ...Show moreLast updated: 30+ days ago
Electrical Engineer (Data Center)

Electrical Engineer (Data Center)

HDRRichmond Hill, York Region, CA
Full-time
Be among the first 25 applicants.At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected, a place where everyone is empowered to b...Show moreLast updated: 30+ days ago
Data Engineer

Data Engineer

Game HiveRichmond Hill, ON, Canada
This job is currently not accepting applicants.Show moreLast updated: 30+ days ago
Data Accelerator - Design Verification Engineer

Data Accelerator - Design Verification Engineer

Advanced Micro DevicesMarkham, York Region, CA
Full-time
WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show moreLast updated: 6 days ago
Lab Engineer

Lab Engineer

IonadaMarkham, York Region, CA
Full-time
Lab Engineer – Research and Development (R&D).Ionada is on a mission to revolutionize carbon capture technology—and we’re looking for a passionate. If you’re driven by innovation, sustainability, an...Show moreLast updated: 30+ days ago
AI Engineer

AI Engineer

GEI Consultants, Inc.Markham, York Region, CA
Full-time
AI Engineer at GEI Consultants, Inc.The AI Engineer is responsible for the development of AI solutions, typically leveraging pretrained models and copilots, to support GEI’s priority digital and AI...Show moreLast updated: 11 days ago
AWS Data Engineer

AWS Data Engineer

TEEMAMarkham, ON
Full-time
Leverage Apache Iceberg for efficient management of large datasets.Develop and maintain data quality checks using AWS Glue. Collaborate with DevOps teams to deploy infrastructure using Terraform.Bui...Show moreLast updated: 30+ days ago
People also ask
Data Engineer

Data Engineer

Integrity AsiaMarkham, York Region, CA
30+ days ago
Job type
  • Full-time
Job description

Join to apply for the Data Engineer role at Integrity Asia .

Get AI-powered advice on this job and more exclusive features.

Are you a passionate data engineer ready to build the infrastructure that powers our insights and decisions? As a Data Engineer , you will support the Data Scientist team by designing and building robust data pipelines, ensuring clean, structured, and accessible data for analytics, modeling, and decision-making processes.

What You’ll Do :

  • Build and Maintain Data Pipelines
  • Develop, test, and maintain scalable ETL / ELT pipelines that collect and process raw data from various sources.
  • Automate data workflows to ensure timely and accurate data availability.
  • Integrate various data formats and APIs into centralized systems.
  • Develop and Manage Data Crawlers
  • Build and maintain scalable web crawlers and data scraping engines to collect information from public or internal websites and APIs.
  • Ensure compliance with ethical and legal web scraping practices (robots.txt, rate limits, etc.).
  • Monitor crawler performance and implement logging, error handling, and retry mechanisms.
  • Data Preparation and Transformation
  • Clean and preprocess raw data to ensure consistency and usability.
  • Create structured datasets from semi-structured and unstructured data.
  • Support feature engineering and data modeling needs of Data Scientists.
  • Data Infrastructure and Tools Management
  • Manage and maintain databases, data lakes, or data warehouses (e.g., SQL, NoSQL, cloud platforms).
  • Set up monitoring and logging for data systems to ensure performance and reliability.
  • Ensure systems scale with data volume and processing demand.
  • Ensure metadata management and proper data cataloging.
  • Collaboration and Support
  • Work closely with Data Scientists to understand project data needs and deliver appropriate data sets.
  • Partner with software engineers, developers, and business stakeholders for end-to-end data solutions.
  • Provide documentation, version control, and data lineage for transparency and reuse.

Who We Need :

  • Bachelor's Degree in Computer Science, Information Systems, Data Engineering, or related field.
  • Post-graduate training or certification in Big Data, Cloud Technologies, or Machine Learning Infrastructure is a plus.
  • Minimum 2–5 years of experience in data engineering, data pipeline development, or backend data.
  • Experience in supporting data science or analytics teams is preferred.
  • Experience building pipelines using Apache Airflow, Kafka, Spark, or similar tools.
  • Strong awareness of Indonesian data compliance frameworks and methodologies.
  • Familiarity with data security, data classification, and secure processing principles in accordance with ISO 27001 or similar standards.
  • Proficiency in Bahasa Indonesia and English (written and verbal) is required.
  • Mastering other languages is a plus.
  • Able to work with cross-functional teams and across cultures.
  • Results-driven, proactive, and comfortable with ambiguity.
  • Robust nature.
  • Mentor, motivator, communicator.
  • Energy & dynamism.
  • Results-oriented mindset with a "can-do" attitude.
  • Able to handle competing objectives and multiple priorities.
  • Clear thinker.
  • Technical Skills Needed :

  • Deep familiarity with MongoDB, PostgreSQL, and Elasticsearch for data warehousing and indexing.
  • Strong programming skills in Python and / or Golang.
  • Strong understanding of REST APIs, web scraping techniques, and asynchronous job queues (Celery, etc.).
  • Proficiency with containerization and orchestration tools like Docker and Kubernetes.
  • Experience with web scraping or crawler engine development (e.g., using Scrapy, Selenium, or custom tools).
  • Knowledge of data modeling, data warehousing, and data lake architectures.
  • If you meet these requirements and are looking for an exciting opportunity within a successful, growing company, then this role is for you!

    Integrity Indonesia is an equal opportunity employer.

    Integrity Indonesia is a foreign investment company operating since 2001 in Indonesia, with affiliates in Malaysia and Thailand. Our business involves services related to the Prevention, Detection, and Investigation of risk.

    As a rapidly expanding company with a robust business plan, Integrity Indonesia seeks self-motivated, results-oriented individuals with solid qualifications who enjoy challenges and growth opportunities.

    Seniority level

  • Associate
  • Employment type

  • Full-time
  • Job function

  • Other
  • Industries

  • Business Consulting and Services
  • #J-18808-Ljbffr