Staffinity is currently seeking a Java Spark Developer for a client in Montreal. This is a permanent position with base salary, benefits, retirement plan, paid education opportunities and vacation.
The salary range is 110-120k. The working hours are Monday to Friday, daytime. The position works on a hybrid model with 3 days per week in the Montreal office.
Bilingualism is not required for this role. The ideal candidate will have working hands on experience of creating and leveraging Splunk dashboard is a huge plus.
Responsibilities :
- Design, develop, and maintain Java applications leveraging Apache Spark for distributed data processing and analytics.
- Collaborate with data engineers and data scientists to implement data pipelines, ETL processes, and machine learning workflows using Spark.
- Optimize and tune Spark jobs to ensure efficient utilization of computing resources and high throughput for data processing tasks.
- Integrate Java applications with Spark clusters, leveraging Spark's APIs and libraries for data manipulation, transformation, and analysis.
- Develop and deploy real-time and batch processing applications using Spark Streaming and Spark SQL for data ingestion and analysis.
- Implement data caching, partitioning, and parallel processing techniques to optimize Spark job performance and resource utilization.
- Work with cloud-based platforms and big data technologies to deploy and manage Spark-based applications in distributed environments.
- Collaborate with cross-functional teams to understand business requirements, data models, and analytics use cases, and implement relevant solutions using Spark.
Qualifications :
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Java Developer with hands-on experience in Apache Spark for data processing and analytics.
- Strong proficiency in Java programming language with a focus on scalable and distributed systems.
- Experience with Apache Spark, Spark Streaming, Spark SQL, and related Spark ecosystem tools and libraries.
- Knowledge of big data technologies such as Hadoop, HDFS, and distributed computing frameworks for large-scale data processing.
- Familiarity with cloud platforms such as AWS, Azure, or GCP for deploying and managing Spark applications.
- Strong understanding of data structures, algorithms, and database technologies for data manipulation and analytics.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Experience with Agile development methodologies and tools (e.g., JIRA, Git) is preferred.
- Certification in Apache Spark or related big data technologies is advantageous.
Java/Spark developer
Experience with Apache Spark, Spark Streaming, Spark SQL, and related Spark ecosystem tools and libraries. Staffinity is currently seeking a Java Spark Developer for a client in Montreal. Integrate Java applications with Spark clusters, leveraging Spark's APIs and libraries for data manipulation, tr...
Sr Big Data Engineer Airflow and Oozie (GCP)
We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. Develop, Manage and optimize data workflows using Oozie and Airflow within the Apache Hadoop ecosystem. Leverage GCP for scalable big data processing and storage solutions. Bachelors's degree in Comput...
Software Support Engineer
At ProviderSoft, a Software Support Engineer is responsible for supporting our clients’ successful use of our products through technical acumen and effective communication. As a Software Support Engineer at ProviderSoft, you will have the opportunity to work closely with a highly skilled team to sup...
Scala Developer
Capgemini is seeking a candidate with solid experience in Scala, Spark, Hive, and Hadoop to join our team of IT professionals. Technical expertise with Spark with scala, Hive, Hadoop. Knowledge of programming languages like Scala and basic Java. ...
Developer, Software Full Stack
As a software developer, the successful candidate will be required to maintain and enhance existing applications as well as deliver new, innovative solutions that meet the company's needs. The software developer will be responsible for assessing, developing and supporting applications based on custo...
Lead Data Engineer
Define and operate the infrastructure required for optimal extraction, transformation and loading (ETL) of data from a wide variety of data sources using SQL and ‘big data’ technologies as needed (Hadoop, MapReduce, Hive, Spark, Kafka, Pig, data streaming, NoSQL, SQL, programming) . You have good kn...
Senior Software Engineer
Bachelor’s degree in Computer/Software Engineering or Computer Science or related field with advanced programming curriculum. Why consider Daktronics for my Software career?. Build software empowering global customers in creating engaging experiences. Develop and maintain full stack software applica...
Intermediate Full Stack .NET Developer
The individual to fulfill this position must be a self-assured independent worker who can clearly understand complex requirements and work with the Developers and Product Managers to develop business applications. They must be able to work closely with Developers, Product Management, Business Requir...
Java Software Engineer (Montreal)
Design, develop, test, and deploy Java-based software applications using the Java Spring and Spring Batch frameworks. Bachelor's degree in Computer Science, Software Engineering, or related field. Our services span Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Ma...
Full Stack Developer (Python & Vue.js)
Team of over 70 developers and growing. We're looking for a full-stack web developer to help build magical experiences for customers of our ecommerce platform. At least 3 years of experience developing web applications with Python, Django, JavaScript, Vue. You'll collaborate with developers all over...