Talent.com
Hadoop Engineer
Hadoop EngineerAccertify, Inc. • Burlington, Halton Region, CA
Hadoop Engineer

Hadoop Engineer

Accertify, Inc. • Burlington, Halton Region, CA
30+ days ago
Job type
  • Full-time
Job description

Job Overview

Join to apply for the Hadoop Engineer role at Accertify, Inc.

Trusted by many of the largest companies globally, Accertify is the leading digital platform assessing risk across the entire customer journey, from Account Monitoring and Payment Risk to Refund Fraud and Dispute Management. Accertify helps maximize revenues and user experience while minimizing loss and customer friction. We offer ultra-fast decision-making and precise control, ensuring our customers are always confidently in the driver’s seat and ready to move at the speed of right.

Be in the driver’s seat of your career as a Hadoop Engineer with the industry leader. We are looking for a Hadoop and Big Data Engineer to administer the multi-petabyte HPE Ezmeral Data Fabric Clusters. Senior Hadoop Engineers are instrumental for the smooth functioning and upkeep of the large volumes of data and analytical services, enabling the users to derive business insights and develop new products. This position will challenge the technical skills of the individual in ensuring the usability and high availability of the Big Data and ML Ops infrastructure to enable analytics, product development, and production operations.

Base Pay Range

$120,000.00 / yr - $145,000.00 / yr

Essential Duties & Responsibilities

  • Upkeep of the HPE EDF cluster, ensuring the data is accessible to users
  • Support user workloads by appropriately designing the queues for appropriate cluster usage
  • Ensure cluster is healthy and the analytics enablement services – Spark, Drill, etc. – are maintained with high availability
  • Monitor cluster usage and uptime, and resolve any issues
  • Participate in pager duty, as needed, to support the cluster operations
  • Maintain and manage edge nodes through which users will access the cluster
  • Interact with users and debug, and access related or other issues that they may be facing
  • Build monitoring tools and other scripts as needed to have strong diagnostics and carry a proactive mindset to preemptively solve issues as identified

Skills & Qualifications

  • 4+ years experience with HPE Ezmeral Datafabric (EDF) or similar ecosystems
  • Deep understanding of Hadoop and big data object storage
  • At least 3 years of experience in administering the cluster
  • 4+ years of experience working with Linux OS and an expert in shell scripting
  • 3+ years of experience in Java, Python, and PySpark
  • 4+ years of experience writing SQL queries across various platforms – RDBMS, Drill, etc.
  • 2+ years of experience writing Spark queries and optimization, including resource allocation
  • Strong understanding of columnar data storage and must have dealt with storage formats such as Parquet and JSON
  • Foundational understanding of networking concepts
  • Data structures, manipulation, and optimization
  • Working knowledge of monitoring skills like Grafana, Splunk, Zabbix, Check MK
  • Additional Details

  • Salary Range : $120,000–145,000. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
  • This role is eligible for remote US-based (work‑from‑home) locations. Chicago‑based candidates would work in a hybrid capacity from the Accertify HQ in Itasca, IL.
  • Visa Sponsorship : Applicants must be authorized to work in the U.S.; Accertify does not provide visa sponsorship for this position.
  • Why Join Accertify?

  • Comprehensive Health Coverage : Enjoy peace of mind with medical, dental, and vision insurance options tailored to your needs.
  • Generous Time Off : Recharge with paid time off, holidays, and personal days to maintain a work‑life balance.
  • Financial Wellness : Plan for the future with competitive pay, a 401(k) retirement plan with company match, and financial planning resources.
  • Professional Growth : Advance your career with access to training, development programs, and opportunities to grow within the company.
  • Wellness Support : Stay healthy with wellness programs, mental health resources, and fitness perks.
  • Perks and Extras : Enjoy additional benefits like commuter assistance, employee discounts, and company-sponsored events.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Engineer • Burlington, Halton Region, CA

    Similar jobs
    Intermediate QA Engineer-AI Engineer- Full-time HYBRID (1772)

    Intermediate QA Engineer-AI Engineer- Full-time HYBRID (1772)

    freelance.ca • Mississauga, Canada
    Full-time +1
    Hybrid (2 days / month in office), office located in Mississauga, Ontario.RRSP, health benefits, 3 weeks vacation.QA Automation, Java, Python, Selenium, Cypress, Playwright, REST API, Web Testing, Mo...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer Operations

    Senior Software Engineer Operations

    Infotek Consulting Inc. • Mississauga, Ontario, Canada
    Temporary
    Senior Software Engineer Operations.Our Digital Business Automation Services team is seeking a Senior Software Engineer with strong experience supporting Enterprise Content Management and Document ...Show more
    Last updated: 2 days ago • Promoted
    Software Development Engineer III

    Software Development Engineer III

    Biiibo Inc. • Concord, ON, Canada
    Full-time
    As a Software Development Engineer lll, you will work as part of a small, autonomous, agile team to deliver both internal and external applications. built on a modern hybrid cloud platform.You will...Show more
    Last updated: 30+ days ago • Promoted
    Director of Engineering – AWS Cloud / DevOps (1802)

    Director of Engineering – AWS Cloud / DevOps (1802)

    freelance.ca • Mississauga, Canada
    Temporary
    Hybrid work model, 2 days / month in Mississauga office.Month Contract with strong possibility of extension.AWS (EC2, S3, RDS, Lambda, ECS, EKS, CloudFront), CloudOps, DevOps, AIOps, Terraform, CI / CD...Show more
    Last updated: 30+ days ago • Promoted
    Senior DevOps Engineer — Cloud, Kubernetes & IaC

    Senior DevOps Engineer — Cloud, Kubernetes & IaC

    Medium • Canada Creek
    Full-time
    A leading cryptocurrency platform located in Canada is looking for a Senior DevOps Engineer to tackle complex technical challenges. This role requires solid experience with AWS and Kubernetes, and y...Show more
    Last updated: 11 days ago • Promoted
    AWS DevOps Engineer

    AWS DevOps Engineer

    J&M Group • Mississauga
    Full-time
    Networking : AWS network load balancer, Route 53, API Gateway.Container orchestration / management : 70+ services running in ECS. Security : AWS Cert manager, Cloudfront.Databases : MySQL, Postgres, Redis...Show more
    Last updated: 30+ days ago • Promoted
    Sr. DevOps Engineer

    Sr. DevOps Engineer

    MacDonald Search Group • Mississauga, ON, Canada
    Full-time
    MacDonald Search Group has been asked by our.The primary responsibility of this role will be to design, build, and optimize a scalable, secure, cloud-native DevOps and CI / CD infrastructure supporti...Show more
    Last updated: 4 days ago • Promoted
    Intermediate Engineer

    Intermediate Engineer

    Danmare Group Inc • Woodbridge, ON, Canada
    Full-time
    About Danmare The Danmare Group specializes in providing full-service engineering and design solutions to leading companies in the food and beverage industry. Over the past fourteen years, clients h...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Rogers Communications • Brampton
    Full-time
    Our Technology team wakes up every day with one goal in mind - connecting Canadians to the people and things that matter most. Together, we are proud to support 30 million Canadians each month throu...Show more
    Last updated: 30+ days ago • Promoted
    Guidewire Engineer

    Guidewire Engineer

    BuzzClan • Oakville, Ontario, Canada
    Full-time
    Guidewire PolicyCenter Configuration – Senior.Year Contract (Extension Possible).Guidewire PolicyCenter Configuration Developer. GOSU, Java, and web development.The ideal candidate will be hands-on ...Show more
    Last updated: 2 days ago • Promoted
    Kafka Devops Engineer

    Kafka Devops Engineer

    Citigroup Inc. • Mississauga
    Full-time
    Join the Kafka as-a-Service (KaaS) App & Infra Operations team, operating within a DevSecOps model and collaborating closely with KaaS Engineering. This role is focused on providing technical suppor...Show more
    Last updated: 11 days ago • Promoted
    Azure Cloud Engineer

    Azure Cloud Engineer

    Apex Systems • Mississauga, Ontario, Canada
    Temporary
    Azure & Container Cloud Engineer.Apex Systems is a global IT services provider, and our staffing practice has an opening for a Azure & Container Cloud Engineer with strong Azure, Container and Bash...Show more
    Last updated: 18 hours ago • Promoted • New!
    Contract Kafka Platform Engineer (Confluent Expert)

    Contract Kafka Platform Engineer (Confluent Expert)

    Kelly • Mississauga
    Full-time
    A technology solutions company is seeking a Kafka Administrator for a contract position in Mississauga, Canada.The ideal candidate will have 6+ years of relevant experience and expertise in the Con...Show more
    Last updated: 30+ days ago • Promoted
    Deployment Engineer

    Deployment Engineer

    Evertz Microsystems Limited • Burlington, ON, CA
    Full-time
    Quick Apply
    The Deployment Engineer is the Evertz product expert whose role is to ensure that their respective product or products are being developed, configured and deployed in the most optimal way possible ...Show more
    Last updated: 30+ days ago
    Intermediate Software Engineer (AIOps)

    Intermediate Software Engineer (AIOps)

    PointClickCare • Mississauga
    Full-time
    At PointClickCare our mission is simple : to help providers deliver exceptional care.And that starts with our people.As a leading health tech company that’s founder‑led and privately held, we empowe...Show more
    Last updated: 11 days ago • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    LTIMindtree • Oakville, Ontario, Canada
    Full-time
    LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace.Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnan...Show more
    Last updated: 2 days ago • Promoted
    Senior DevOps Engineer, Canada

    Senior DevOps Engineer, Canada

    Medium • Canada Creek
    Full-time
    We are a team to design, develop, maintain, and improve software for various ventures projects, i.You will be actively involved in the design of various components behind scalable applications, fro...Show more
    Last updated: 10 days ago • Promoted
    Rhapsody Developer

    Rhapsody Developer

    Yochana • Oakville, Ontario, Canada
    Full-time +1
    Location – 100% Remote - Canada.The Rhapsody Integration Developer & Analyst will be responsible for designing, developing, testing, deploying, and supporting HL7, FHIR, and other healthcare data i...Show more
    Last updated: 18 hours ago • Promoted • New!