Search jobs > Mississauga, ON > Big data developer

Big Data Developer - Spark, Scala, Kakfka

Astra North Infoteck Inc.
Mississauga, ON, ca
Full-time

Spark, Scala, Bigdata, Kafka, NoSQL

Role Description :

Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns

Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework

Develop / Integrate the code adhering to CI / CD, using Spark Framework in Scala / Java

Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA.

Create Junit tests and ensure code coverage is met as per the agreed standards

Should be able to work with a team who might be geographically distributed.

Review the code modules developed by other juniors.

Competencies : Digital : Bigdata and Hadoop Ecosystems, Digital : Scala

Experience (Years) : 4-6

Essential Skills :

Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting

Should be comfortable with Unix File system as well as HDFS commands

Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB

Should be flexible

Should have good communication and customer management skills

Desirable Skills :

Should have knowledge on big data Data Ingestion tools such as SQOOP and KAFKA.

Should be aware of the components in Big Data ecosystem.

Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.

3 days ago
Related jobs
Randstad Canada
Toronto, Ontario

Experience with Big data stack is an advantage. Are you a Software Developer looking for a new opportunity?. We are pleased to offer you a new contract opportunity for you to consider: Software Developer. Relational and Object database knowledge 2-3 years. ...

0000050007 Royal Bank of Canada
Toronto, Ontario

Amazon Redshift, Apache Hadoop, Apache Spark, AWS Cloud Computing, Big Data Management, Cloud Computing, Data Warehouse Development, Docker (Software), Java, Kubernetes, Microservices Architecture, Microsoft Azure, Microsoft Azure Databricks, Python (Programming Language), Red Hat OpenShift, Require...

Autodesk
Toronto, Ontario

Autodesk is looking for a Senior Software Developer, Big Data with experience building data pipelines to join our Enterprise Data Engineering & Visualisation (EDEV) team. Strong technical and problem-solving skills and continuous interest in learning best of class technologies around data warehousin...

hays-gcj-v4-pd-online
Toronto, Ontario

Big Data Developer (Contract - 6 months)Location:. Collaborate with data engineers, data scientists, and business analysts to ensure efficient data processing. Write efficient code in Java, Scala, and Apache Spark for data transformation and analysis. Design, develop, and maintain big data solutions...

Macropus Global
Canada

Big Data Hadoop and Spark Developer certification is a Big Plus. BIG DATA Application Developer & Product Trainer. We have an immediate need/opening of an expert in Big Data Application Developer for a fulltime in. Apache Hadoop, Spark or related big data projects. ...

Astra North Infoteck Inc.
Toronto, Ontario

Big Data applications using Java/Scala and Spark on Cloudera/HDP. Hadoop Spark and Java/Scala Developer with Minimum 5 years of hands-on experience. Must to Have: 5+ years application development experience in Hadoop Spark and Java/Scala. Nice to Have Experience in building data pipelines on AWS/Azu...

Astra North Infoteck Inc.
Toronto, Ontario

Java, Spark, Hadoop, Big Data, Vue. ...

RBC - Royal Bank
Toronto, Ontario

Amazon Redshift, Apache Hadoop, Apache Spark, AWS Cloud Computing, Big Data Management, Cloud Computing, Data Warehouse Development, Docker (Software), Java, Kubernetes, Microservices Architecture, Microsoft Azure, Microsoft Azure Databricks, Python (Programming Language), Red Hat OpenShift, Require...

Astra North Infoteck Inc.
Toronto, Ontario

Java, Spark, Hadoop, Big Data, Vue. Proven knowledge & architecture experience in, architecture (digital / digital marketing / micro / macro / monolithic services, APIs), application integration, service-oriented architecture, event-driven architecture, application architecture, distributed architec...

Astra North Infoteck Inc.
Toronto, Ontario

Big Data applications using Java/Scala and Spark on Cloudera/HDP. Hadoop Spark and Java/Scala Developer with Minimum 5 years of hands-on experience. Must to Have: 5+ years application development experience in Hadoop Spark and Java/Scala. Nice to Have Experience in building data pipelines on AWS/Azu...