Search jobs > Mississauga, ON > Big data developer
Spark, Scala, Bigdata, Kafka, NoSQL
Role Description :
Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns
Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework
Develop / Integrate the code adhering to CI / CD, using Spark Framework in Scala / Java
Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA.
Create Junit tests and ensure code coverage is met as per the agreed standards
Should be able to work with a team who might be geographically distributed.
Review the code modules developed by other juniors.
Competencies : Digital : Bigdata and Hadoop Ecosystems, Digital : Scala
Experience (Years) : 4-6
Essential Skills :
Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting
Should be comfortable with Unix File system as well as HDFS commands
Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB
Should be flexible
Should have good communication and customer management skills
Desirable Skills :
Should have knowledge on big data Data Ingestion tools such as SQOOP and KAFKA.
Should be aware of the components in Big Data ecosystem.
Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.
Big Data Developer - Spark, Scala, Kakfka
Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA. Spark, Scala, Bigdata, Kafka, NoSQL. Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark f...
Big Data Developer
Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework Develop/Integrate the code adhering to CI/CD, using Spark Fram...
Sr Full Stack Spark Scala Developer
Full Stack Developer Required Technical Skills:. Experience with data models and entity relationships. ...
Solution Architect - Java, Spark, Hadoop, Big Data, Vue.js/Node.js
Java, Spark, Hadoop, Big Data, Vue. ...
Software Developer- UI, Big Data
Experience with Big data stack is an advantage. Are you a Software Developer looking for a new opportunity?. We are pleased to offer you a new contract opportunity for you to consider: Software Developer. Relational and Object database knowledge 2-3 years. ...
Big Data Developer with Java
Big Data applications using Java/Scala and Spark on Cloudera/HDP. Hadoop Spark and Java/Scala Developer with Minimum 5 years of hands-on experience. Must to Have: 5+ years application development experience in Hadoop Spark and Java/Scala. Nice to Have Experience in building data pipelines on AWS/Azu...
Big Data Developer, GFT
Amazon Redshift, Apache Hadoop, Apache Spark, AWS Cloud Computing, Big Data Management, Cloud Computing, Data Warehouse Development, Docker (Software), Java, Kubernetes, Microservices Architecture, Microsoft Azure, Microsoft Azure Databricks, Python (Programming Language), Red Hat OpenShift, Require...
Solution Architect - Java, Spark, Hadoop, Big Data, Vue.js/Node.js
Java, Spark, Hadoop, Big Data, Vue. Proven knowledge & architecture experience in, architecture (digital / digital marketing / micro / macro / monolithic services, APIs), application integration, service-oriented architecture, event-driven architecture, application architecture, distributed architec...
Sr. Java Dev / Big Data Developer
Big Data applications using Java/Scala and Spark on Cloudera/HDP. Java, Spark, Hadoop, Spark and Scala. Experience in building data pipelines on AWS/Azure and/or Databricks. The primary focus of this role is to provide re-engineering expertise, covering design, implementation and support of the RM a...
Big Data Developer with Java
Big Data applications using Java/Scala and Spark on Cloudera/HDP. Hadoop Spark and Java/Scala Developer with Minimum 5 years of hands-on experience. Must to Have: 5+ years application development experience in Hadoop Spark and Java/Scala. Nice to Have Experience in building data pipelines on AWS/Azu...