Big Data Dev w/ Java, Scala (AML)

Position Description:

We are Canada's largest independent information technology services firm, and after 45 years, we're still growing! Join Canada's largest IT Company as a "Java Developer" in our Banking Services Division.
This is a hybrid role requiring on-site presence at the client office a minimum of 4 days per week (subject to change).

Your future duties and responsibilities:

• Design, develop, and maintain scalable ETL/data pipelines using Apache Spark.
• Process large structured and unstructured datasets across distributed systems.
• Build real-time and batch processing solutions (Spark Streaming/Structured Streaming).
• Work with big data technologies including Hadoop, Hive, HBase, and Kafka.
• Optimize Spark jobs for performance, scalability, and resource utilization.
• Design data models and manage distributed storage (HDFS, S3, Azure Blob).
• Implement monitoring, logging, and production support best practices.
• Ensure data security, governance, and regulatory compliance (AML, GDPR, etc.).
• Collaborate with cross-functional teams to translate business requirements into technical solutions.

Required qualifications to be successful in this role:

Required Skills
• Strong proficiency in Apache Spark (Core, SQL, Streaming, MLlib).
• Strong programming skills in Scala (primary) and/or Java.
• Experience with Hadoop ecosystem and distributed processing frameworks.
• Familiarity with cloud platforms (AWS, Azure, or GCP).
• Solid understanding of data modeling and warehousing concepts.
• Strong debugging and performance tuning skills.

Nice to Have
• Experience with CI/CD and DevOps for data pipelines.
• Exposure to ML frameworks.
• Knowledge of Docker and Kubernetes.

Skills:

• Code Review
• Code Review
• Database Design
• Performance/Stress Testing
• Software Architecture
• Software Design Patterns
• Financial Services
• Java
• Python
• Scala