Hadoop Engineer

hays-gcj-v4-pd-online
Toronto
$75 an hour
Temporary

Position : Hadoop EngineerLocation : Downtown Toronto (3 days in office, 6 months contract)Responsibilities :

  • Provide Cloudera Distribution Hadoop (CDH) support, including implementation, maintenance, and sustainment of the CDH stack.
  • Work with CDHponents such as Solr, Nifi, Kafka, HDFS, Impala, Yarn, CDSW, Hive, Hue, Flume, Spark, Sqoop, Oozie, and ZooKeeper1.
  • Ingest data into Hadoop across various ecosystem areas, including HDFS.
  • Ensure the quality, stability, scalability, availability, performance, cost-effectiveness, and security of the technology solutions delivered.
  • Automate the operation, installation, and monitoring of Hadoop ecosystemponents within an open-source infrastructure stack.
  • Evaluate Hadoop infrastructure requirements and design / deploy solutions, including high availability and big data clusters.
  • Analyze existing Hadoop systems and applications to improve performance and rmend and implement enhancements.
  • Develop hardware specifications based on planned usage patterns for a Hadoop cluster.
  • Collaborate with client support teams to resolve performance-related issues and data ingestion challenges.

Qualifications :

  • Bachelor’s or Master’s degree inputer Science, Technical, Engineering, Information Technology, Information Systems, Business,puter Engineering, Education, Software Engineering, or Statistics.
  • Relevant certifications such as SSL, MS, PMI, AWS, V3, ITIL, PMP, X.509, HDPCA, or HDP.
  • Desired skills : Must-Have

Skills : KafkaHiveSparkHBaseOozieFlumeBest practices related to securityChef (particularly Hadoop Security using Kerberos and Active Directory)Good-to-Have

Skills : DynatraceSplunkDatabase (DB) and Unix knowledgeNice-to-Have

Skills : Dremio or equivalent experience working in Databricks

LI-DNI

1113661 - Vandana Desai

30+ days ago
Related jobs
Astra North Infoteck Inc.
ON, ON, ca

Python / R experience with programming languages such as Python R .Experience executing projects as a team in Agile environments (Kanban and Scrum).Experience in user interface frameworks/platforms (Angular React etc.Experience with relational and NoSQL databases.Experience with DevOps Continuous In...

Astra North Infoteck Inc.
ON, ON, ca

Python / R experience with programming languages such as Python R .Experience executing projects as a team in Agile environments (Kanban and Scrum).Experience in user interface frameworks/platforms (Angular React etc.Experience with relational and NoSQL databases.Experience with DevOps Continuous In...

Astra North Infoteck Inc.
Mississauga, Ontario

Python / R experience with programming languages such as Python R .Experience executing projects as a team in Agile environments (Kanban and Scrum).Experience in user interface frameworks/platforms (Angular React etc.Experience with relational and NoSQL databases.Experience with DevOps Continuous In...

hays-gcj-v4-pd-online
Toronto, Ontario

Bachelor’s or Master’s degree inputer Science, Technical, Engineering, Information Technology, Information Systems, Business,puter Engineering, Education, Software Engineering, or Statistics. Position: Hadoop EngineerLocation: Downtown Toronto (3 days in office, 6 months contract)Responsibilities:. ...

Rackspace
Remote, Canada
Remote

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). Develop ...

Virtusa
Mississauga, Ontario

Good understanding and experience BigData - Spark, Python, SQL, Data modelling, Data design, Business Analysis. Good understanding and experience BigData - Spark, Python, SQL, Data modelling, Data design, Business Analysis. Big Data Developer - CREQ194838 Description. ...

Dynata
Toronto, Ontario
Remote

The Data Scientist will be responsible for contributing to the development and automation of a suite of data science products and research activities to Dynata’s global client base. The Senior Data Scientist role will support product development and automation supporting the delivery of insights for...

Noise
Toronto, Ontario

Job description is not available....

Nascent
Toronto, Ontario

A Computer Science/Software Engineering/Computer Engineering or related degree. You have a strong knowledge of object-oriented programming and software design patterns, such as AOP, MVC, MVVM, etc. You enjoy working in a fast and lean software environment. ...

Snaplii Inc.
Mississauga, Ontario

Research and document data requirements, data collection and administration policy, and data access rules. Operate database management systems to analyze data. Develop and implement data administration policy, standards and models. Develop policies and procedures for network access and usage and for...