Talent.com
Hadoop Engineer
Hadoop EngineerAccertify, Inc. • Burlington, Halton Region, CA
Hadoop Engineer

Hadoop Engineer

Accertify, Inc. • Burlington, Halton Region, CA
28 days ago
Job type
  • Full-time
Job description

Job Overview

Join to apply for the Hadoop Engineer role at Accertify, Inc.

Trusted by many of the largest companies globally, Accertify is the leading digital platform assessing risk across the entire customer journey, from Account Monitoring and Payment Risk to Refund Fraud and Dispute Management. Accertify helps maximize revenues and user experience while minimizing loss and customer friction. We offer ultra-fast decision-making and precise control, ensuring our customers are always confidently in the driver’s seat and ready to move at the speed of right.

Be in the driver’s seat of your career as a Hadoop Engineer with the industry leader. We are looking for a Hadoop and Big Data Engineer to administer the multi-petabyte HPE Ezmeral Data Fabric Clusters. Senior Hadoop Engineers are instrumental for the smooth functioning and upkeep of the large volumes of data and analytical services, enabling the users to derive business insights and develop new products. This position will challenge the technical skills of the individual in ensuring the usability and high availability of the Big Data and ML Ops infrastructure to enable analytics, product development, and production operations.

Base Pay Range

$120,000.00 / yr - $145,000.00 / yr

Essential Duties & Responsibilities

  • Upkeep of the HPE EDF cluster, ensuring the data is accessible to users
  • Support user workloads by appropriately designing the queues for appropriate cluster usage
  • Ensure cluster is healthy and the analytics enablement services – Spark, Drill, etc. – are maintained with high availability
  • Monitor cluster usage and uptime, and resolve any issues
  • Participate in pager duty, as needed, to support the cluster operations
  • Maintain and manage edge nodes through which users will access the cluster
  • Interact with users and debug, and access related or other issues that they may be facing
  • Build monitoring tools and other scripts as needed to have strong diagnostics and carry a proactive mindset to preemptively solve issues as identified

Skills & Qualifications

  • 4+ years experience with HPE Ezmeral Datafabric (EDF) or similar ecosystems
  • Deep understanding of Hadoop and big data object storage
  • At least 3 years of experience in administering the cluster
  • 4+ years of experience working with Linux OS and an expert in shell scripting
  • 3+ years of experience in Java, Python, and PySpark
  • 4+ years of experience writing SQL queries across various platforms – RDBMS, Drill, etc.
  • 2+ years of experience writing Spark queries and optimization, including resource allocation
  • Strong understanding of columnar data storage and must have dealt with storage formats such as Parquet and JSON
  • Foundational understanding of networking concepts
  • Data structures, manipulation, and optimization
  • Working knowledge of monitoring skills like Grafana, Splunk, Zabbix, Check MK
  • Additional Details

  • Salary Range : $120,000–145,000. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
  • This role is eligible for remote US-based (work‑from‑home) locations. Chicago‑based candidates would work in a hybrid capacity from the Accertify HQ in Itasca, IL.
  • Visa Sponsorship : Applicants must be authorized to work in the U.S.; Accertify does not provide visa sponsorship for this position.
  • Why Join Accertify?

  • Comprehensive Health Coverage : Enjoy peace of mind with medical, dental, and vision insurance options tailored to your needs.
  • Generous Time Off : Recharge with paid time off, holidays, and personal days to maintain a work‑life balance.
  • Financial Wellness : Plan for the future with competitive pay, a 401(k) retirement plan with company match, and financial planning resources.
  • Professional Growth : Advance your career with access to training, development programs, and opportunities to grow within the company.
  • Wellness Support : Stay healthy with wellness programs, mental health resources, and fitness perks.
  • Perks and Extras : Enjoy additional benefits like commuter assistance, employee discounts, and company-sponsored events.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Engineer • Burlington, Halton Region, CA

    Similar jobs
    Senior DevOps Engineer / / Ingnieur DevOps senior

    Senior DevOps Engineer / / Ingnieur DevOps senior

    Finsana • Oakville, ON, Canada
    Full-time
    FINSANA is a global fintech company that specializes in catering to underserved and underbanked consumers.Our organization has a passion for helping people financially through our technology soluti...Show more
    Last updated: 30+ days ago • Promoted
    Software Development Engineer III

    Software Development Engineer III

    Biiibo Inc. • Concord, ON, Canada
    Full-time
    As a Software Development Engineer lll, you will work as part of a small, autonomous, agile team to deliver both internal and external applications. built on a modern hybrid cloud platform.You will...Show more
    Last updated: 30+ days ago • Promoted
    Director of Engineering – AWS Cloud / DevOps (1802)

    Director of Engineering – AWS Cloud / DevOps (1802)

    freelance.ca • Mississauga, Canada
    Temporary
    Hybrid work model, 2 days / month in Mississauga office.Month Contract with strong possibility of extension.AWS (EC2, S3, RDS, Lambda, ECS, EKS, CloudFront), CloudOps, DevOps, AIOps, Terraform, CI / CD...Show more
    Last updated: 22 days ago • Promoted
    Azure DevOps Engineer - oakville

    Azure DevOps Engineer - oakville

    LTIMindtree • oakville, on, ca
    Full-time
    LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace.Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnan...Show more
    Last updated: 6 days ago • Promoted
    Project Manager

    Project Manager

    Intelliswift - An LTTS Company • mississauga, on, ca
    Full-time
    We are seeking a skilled Project Manager to lead the delivery and governance of the DDI DNS Anycast Project, which involves deploying new DNS appliances to enhance resiliency and performance for cr...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead, Network and Cloud Engineer

    Lead, Network and Cloud Engineer

    MCKESSON • Mississauga, ON, Canada
    Full-time
    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...Show more
    Last updated: 30+ days ago • Promoted
    Product Owner - Extend Information Systems Inc.

    Product Owner - Extend Information Systems Inc.

    Extend Information Systems Inc. • oakville, on, ca
    Full-time
    Product Owner – Smart Water Solutions.We are seeking a mission-driven Product Owner to guide development of an early-stage software product focused on solving major water utility challenges—such as...Show more
    Last updated: 3 hours ago • Promoted • New!
    Azure Cloud Engineer - Apex Systems

    Azure Cloud Engineer - Apex Systems

    Apex Systems • mississauga, on, ca
    Temporary
    Azure & Container Cloud Engineer.Apex Systems is a global IT services provider, and our staffing practice has an opening for a Azure & Container Cloud Engineer with strong Azure, Container and Bash...Show more
    Last updated: 6 days ago • Promoted
    Go Engineer

    Go Engineer

    SuperAnnotate • Oakville, Ontario, CA
    Remote
    Full-time
    As an hourly paid, fully remote Go Engineer for AI Data Training, you will review AI-generated Go code and explanations or generate your own, evaluate the reasoning quality and step-by-step problem...Show more
    Last updated: 18 hours ago • New!
    Intermediate Engineer

    Intermediate Engineer

    Danmare Group Inc • Woodbridge, ON, Canada
    Full-time
    About Danmare The Danmare Group specializes in providing full-service engineering and design solutions to leading companies in the food and beverage industry. Over the past fourteen years, clients h...Show more
    Last updated: 30+ days ago • Promoted
    Senior Java Software Engineer - Luxoft

    Senior Java Software Engineer - Luxoft

    Luxoft • burlington, on, ca
    Full-time
    One of the world's largest providers of products and services to the energy industry has a need to develop and support enterprise information system in Oil & Gas domain. Product being developed is a...Show more
    Last updated: 23 days ago • Promoted
    Application Developer

    Application Developer

    HCLTech • mississauga, on, ca
    Full-time
    Design, develop, and maintain microservices-based applications using Java and Spring Boot frameworks.Implement event-driven architectures leveraging Apache Kafka for asynchronous communication.Arch...Show more
    Last updated: 25 days ago • Promoted
    Manager, End User Operations

    Manager, End User Operations

    goeasy • Mississauga, ON, Canada
    Full-time
    Join one of Canada’s fastest-growing companies and be part of something extraordinary – welcome to .At goeasy, our people and culture are at the heart of everything we do,...Show more
    Last updated: 30+ days ago • Promoted
    Pega Developer - Tekgence Inc

    Pega Developer - Tekgence Inc

    Tekgence Inc • mississauga, on, ca
    Full-time
    Design, develop, enhance, and support.Pega guardrails and best practices, with recommended certification at the.Pega Lead System Architect (LSA). Developer, Technical Lead, or Project Manager.Troubl...Show more
    Last updated: 1 hour ago • Promoted • New!
    Technology Enterprise Architect

    Technology Enterprise Architect

    KPMG Canada • Oakville B8B, ON, Canada
    Full-time
    Be among the first 25 applicants.At KPMG, you’ll join a team of diverse and dedicated problem solvers, connected by a common cause turning insight into opportunity for clients and communities aroun...Show more
    Last updated: 30+ days ago • Promoted
    Hybrid Cloud Solutions Architect — Loyalty Platform

    Hybrid Cloud Solutions Architect — Loyalty Platform

    Sobeys • Mississauga
    Full-time
    A leading Canadian retailer is seeking a Solution Architect to drive innovative solutions for their loyalty program.You will design and implement cloud-native architectures, work collaboratively wi...Show more
    Last updated: 14 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    REV Capital • Concord, ON, Canada
    Full-time
    We're seeking an experienced Full Stack Engineer to join our engineering team.The ideal candidate will have deep expertise in Node. Google Cloud Platform (GCP) architecture, and DevOps practices...Show more
    Last updated: 5 days ago • Promoted
    Guidewire Engineer - oakville

    Guidewire Engineer - oakville

    BuzzClan • oakville, on, ca
    Full-time
    Guidewire PolicyCenter Configuration – Senior.Year Contract (Extension Possible).Guidewire PolicyCenter Configuration Developer. GOSU, Java, and web development.The ideal candidate will be hands-on ...Show more
    Last updated: 30+ days ago • Promoted