Big Data Engineer (Remote)

Req ID : 256699

NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Big Data Engineer (Remote) to join our team in Toronto, Ontario (CA-ON), Canada (CA).

Job Description for Big Data Engineer with Spark and Scala development experience :

• 5+ years of total Experience in Java / Scala.
• 5+ years of hands-on experience in Hadoop programming
• excellent knowledge on SQL Query writing (understanding of different joins, indexes, views, etc.,)
• Hands-on experience in Java, Scala, and Spark
• Hands-on experience with Kafka, NiFi, AWS , Maven, Stash, and Bamboo
• Hands-on experience in writing MapReduce jobs. - Good knowledge on spark architecture.
• Writing high-performance, reliable, and maintainable code. - Good knowledge of database structures, theories, principles, and practices.
• Good understanding of Hadoop , YARN, AWS EMR
• Familiarity with data loading tools like Talend, and Sqoop - Familiarity with cloud databases like AWS Redshift, and Aurora MySQL.
• Familiarity of Apache Zeppelin / EMR Notebook.
• Knowledge of workflow / schedulers like Oozie or Apache Airflow.
• Analytical and problem-solving skills applied to the Big Data domain - Strong exposure in Object Oriented concepts and implementation
• Proven understanding of Hadoop, HBase, Hive, and HBase - Good aptitude in multi-threading and concurrency concepts

Duties :

• Create Scala / Spark jobs for data transformation and aggregation.
• Produce unit tests for Spark transformations and helper methods.
• Write Scala doc-style documentation with all code.
• Design data processing pipelines.
• Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem.
• Ability to design and implement end-to-end solutions. Build utilities, user-defined functions, and frameworks to better enable data flow patterns.

About NTT DATA Services

NTT DATA Services is a recognized leader in IT and business services, including cloud, data, and applications, headquartered in Texas.

As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications development and management, managed edge-to-cloud infrastructure services, BPO, systems integration, and global data centers.

We are committed to our clients' long-term success. Visit nttdata.com or LinkedIn to learn more.

NTT DATA Services is an equal opportunity employer and considers all applicants without regard to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law.

We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.

INDHCLSMC