Big Data Dev w / Java, Scala (AML)

Position Description :

We are Canada's largest independent information technology services firm, and after 45 years, we're still growing! Join Canada's largest IT Company as a "Java Developer" in our Banking Services Division.

This is a hybrid role requiring on-site presence at the client office a minimum of 4 days per week (subject to change).

Your future duties and responsibilities :

• Design, develop, and maintain scalable ETL / data pipelines using Apache Spark.
• Process large structured and unstructured datasets across distributed systems.
• Build real-time and batch processing solutions (Spark Streaming / Structured Streaming).
• Work with big data technologies including Hadoop, Hive, HBase, and Kafka.
• Optimize Spark jobs for performance, scalability, and resource utilization.
• Design data models and manage distributed storage (HDFS, S3, Azure Blob).
• Implement monitoring, logging, and production support best practices.
• Ensure data security, governance, and regulatory compliance (AML, GDPR, etc.).
• Collaborate with cross-functional teams to translate business requirements into technical solutions.

Required qualifications to be successful in this role :

Required Skills

Strong proficiency in Apache Spark (Core, SQL, Streaming, MLlib).

Strong programming skills in Scala (primary) and / or Java.

Experience with Hadoop ecosystem and distributed processing frameworks.

Familiarity with cloud platforms (AWS, Azure, or GCP).

Solid understanding of data modeling and warehousing concepts.

Strong debugging and performance tuning skills.

Nice to Have

Experience with CI / CD and DevOps for data pipelines.

Exposure to ML frameworks.

Knowledge of Docker and Kubernetes.

Skills :

Code Review

Code Review

Database Design

Performance / Stress Testing

Software Architecture

Software Design Patterns

Financial Services

Java

Python

Scala