Big Data Developer

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?

First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.

Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.

Big Data Engineer

Job Description :

• Bachelor’s Degree or Master’s in Computer Science, Engineering, Software Engineering or a relevant field.
• 10+ years of software development experience building large scale distributed data processing systems / application or large-scale internet systems.
• Must have good communication skills, writing clean code.
• Strong experience in Python, Kafka, Spark, SQL, Hive, Couchbase, Impala, Hadoop, Splunk, Autosys, shell scripting etc.
• Strong Cloud experience on AWS Lambda, AWS EMR, AWS S3, AWS EC2, EKS.
• Experience in DevOps Activity (Snow, Build (TeamCity, Jenkins, Terraform) and U-Deploy.
• Good knowledge on Capital Market and Data Analysis.
• Experience in dealing with Huge Volume of Data operations.
• Design best architecture and select the most appropriate modeling techniques and data visualization for big data analysis.
• Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera / Hadoop logs)
• Experience with Linux-based infrastructures, Linux / Unix administration, and Cloud.

FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.