Position : Hadoop EngineerLocation : Downtown Toronto (3 days in office, 6 months contract)Responsibilities :
- Provide Cloudera Distribution Hadoop (CDH) support, including implementation, maintenance, and sustainment of the CDH stack.
- Work with CDHponents such as Solr, Nifi, Kafka, HDFS, Impala, Yarn, CDSW, Hive, Hue, Flume, Spark, Sqoop, Oozie, and ZooKeeper1.
- Ingest data into Hadoop across various ecosystem areas, including HDFS.
- Ensure the quality, stability, scalability, availability, performance, cost-effectiveness, and security of the technology solutions delivered.
- Automate the operation, installation, and monitoring of Hadoop ecosystemponents within an open-source infrastructure stack.
- Evaluate Hadoop infrastructure requirements and design / deploy solutions, including high availability and big data clusters.
- Analyze existing Hadoop systems and applications to improve performance and rmend and implement enhancements.
- Develop hardware specifications based on planned usage patterns for a Hadoop cluster.
- Collaborate with client support teams to resolve performance-related issues and data ingestion challenges.
Qualifications :
- Bachelor’s or Master’s degree inputer Science, Technical, Engineering, Information Technology, Information Systems, Business,puter Engineering, Education, Software Engineering, or Statistics.
- Relevant certifications such as SSL, MS, PMI, AWS, V3, ITIL, PMP, X.509, HDPCA, or HDP.
- Desired skills : Must-Have
Skills : KafkaHiveSparkHBaseOozieFlumeBest practices related to securityChef (particularly Hadoop Security using Kerberos and Active Directory)Good-to-Have
Skills : DynatraceSplunkDatabase (DB) and Unix knowledgeNice-to-Have
Skills : Dremio or equivalent experience working in Databricks
LI-DNI
1113661 - Vandana Desai
30+ days ago