- Search jobs
- Markham, ON
- big data engineer
Big data engineer Jobs in Markham, ON
Create a job alert for this search
Big data engineer • markham on
Data Engineer
Integrity AsiaMarkham, York Region, CADeveloper - Emerging technologies (Big Data, Mobile, Cloud, RPA) - 5
LancesoftScarborough, ON, CASenior Data Engineer
Aarorn Technologies IncMarkham, York Region, CAManager, Data Engineer
ScotiabankScarborough, ON, CABig Data Architect
BMO Financial GroupScarborough, ONData Engineer
Xplore Inc.Markham, York Region, CAData Engineer
Compunnel Inc.Markham, York Region, CAAnalytics Data Engineer
Frontier Dental SupplyMarkham, Ontario, CanadaData Engineer
Quantum Management ServicesNorth York, ON (HybridDatabase Research Expert - Big Data Platform
HuaweiMarkham, York Region, CAData Engineer & Analytics
Kredivo GroupMarkham, York Region, CAElectrical Engineer (Data Center)
Fashion Institute of Design & MerchandisingRichmond Hill, York Region, CASenior C++ Big Data Engineer - Systems & Algorithms
Huawei Technologies Canada Co., Ltd.Markham, York Region, CAElectrical Engineer (Data Center)
HDRRichmond Hill, York Region, CAData Engineer
Game HiveRichmond Hill, ON, CanadaData Accelerator - Design Verification Engineer
Advanced Micro DevicesMarkham, York Region, CALab Engineer
IonadaMarkham, York Region, CAAI Engineer
GEI Consultants, Inc.Markham, York Region, CAAWS Data Engineer
TEEMAMarkham, ON- Thunder Bay, ON (from $ 153,488 to $ 164,549 year)
- North Bay, ON (from $ 141,672 to $ 163,486 year)
- Montreal-Ouest, QC (from $ 153,338 to $ 157,769 year)
- Montreal, QC (from $ 153,338 to $ 157,769 year)
- Quebec City, QC (from $ 115,000 to $ 157,741 year)
- Mississauga, ON (from $ 129,575 to $ 157,083 year)
- Vancouver, BC (from $ 115,000 to $ 156,494 year)
- St. John's, NL (from $ 115,000 to $ 156,494 year)
- Old toronto, ON (from $ 115,000 to $ 156,228 year)
- East York, ON (from $ 115,000 to $ 156,063 year)
Popular searches
Data Engineer
Integrity AsiaMarkham, York Region, CA- Full-time
Join to apply for the Data Engineer role at Integrity Asia .
Get AI-powered advice on this job and more exclusive features.
Are you a passionate data engineer ready to build the infrastructure that powers our insights and decisions? As a Data Engineer , you will support the Data Scientist team by designing and building robust data pipelines, ensuring clean, structured, and accessible data for analytics, modeling, and decision-making processes.
What You’ll Do :
- Build and Maintain Data Pipelines
- Develop, test, and maintain scalable ETL / ELT pipelines that collect and process raw data from various sources.
- Automate data workflows to ensure timely and accurate data availability.
- Integrate various data formats and APIs into centralized systems.
- Develop and Manage Data Crawlers
- Build and maintain scalable web crawlers and data scraping engines to collect information from public or internal websites and APIs.
- Ensure compliance with ethical and legal web scraping practices (robots.txt, rate limits, etc.).
- Monitor crawler performance and implement logging, error handling, and retry mechanisms.
- Data Preparation and Transformation
- Clean and preprocess raw data to ensure consistency and usability.
- Create structured datasets from semi-structured and unstructured data.
- Support feature engineering and data modeling needs of Data Scientists.
- Data Infrastructure and Tools Management
- Manage and maintain databases, data lakes, or data warehouses (e.g., SQL, NoSQL, cloud platforms).
- Set up monitoring and logging for data systems to ensure performance and reliability.
- Ensure systems scale with data volume and processing demand.
- Ensure metadata management and proper data cataloging.
- Collaboration and Support
- Work closely with Data Scientists to understand project data needs and deliver appropriate data sets.
- Partner with software engineers, developers, and business stakeholders for end-to-end data solutions.
- Provide documentation, version control, and data lineage for transparency and reuse.
Who We Need :
Technical Skills Needed :
If you meet these requirements and are looking for an exciting opportunity within a successful, growing company, then this role is for you!
Integrity Indonesia is an equal opportunity employer.
Integrity Indonesia is a foreign investment company operating since 2001 in Indonesia, with affiliates in Malaysia and Thailand. Our business involves services related to the Prevention, Detection, and Investigation of risk.
As a rapidly expanding company with a robust business plan, Integrity Indonesia seeks self-motivated, results-oriented individuals with solid qualifications who enjoy challenges and growth opportunities.
Seniority level
Employment type
Job function
Industries
#J-18808-Ljbffr