Data Engineer

Mandatory Skills : Python, Cloud experience, kafka , Openshift , ECS.Qualifications : 8+ years of experience in hadoop / big data technologies.3+ years of experience in spark.2+ years’ experience in Snowflake2+ year of experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python / Pyspark / Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker, Kubernetes)Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)1 year Hadoop administration experience preferred1+ year of SAS experience preferred.Comprehensive knowledge of the principles of software engineering and data analyticsAdvanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)Knowledge of agile (scrum) development methodology is a plusStrong development / automation skillsProficient in programming in Java or Python with prior Apache Beam / Spark experience a plus. System level understanding - Data structures, algorithms, distributed storage & computeCan-do attitude on solving complex business problems, good interpersonal and teamwork skills