Talent.com
Big Data and SQL Developer
Big Data and SQL DeveloperPowerToFly • Mississauga, Peel Region, CA
Big Data and SQL Developer

Big Data and SQL Developer

PowerToFly • Mississauga, Peel Region, CA
1 day ago
Job type
  • Full-time
Job description

Overview

The Big Data and SQL Developer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Responsibilities

  • Technical Design & Implementation (60-70%) :

Architecture & Design : Lead the design and implementation of highly scalable, robust, and performant Big Data solutions, including data warehouses, streaming platforms, and analytical systems.

  • Hands-on Development : Write high-quality, production-ready code for complex data pipelines, processing frameworks, and analytical tools using languages like Scala, Python, or Java.
  • Performance Optimization : Drive performance tuning, troubleshooting, and optimization of Big Data applications and infrastructure.
  • Technical Problem Solving : Act as a go-to expert for resolving complex technical challenges across the Big Data ecosystem.
  • Innovation : Research, evaluate, and integrate new Big Data technologies and tools to enhance existing platforms and capabilities.
  • Best Practices : Champion and enforce engineering best practices, including code quality, testing, CI / CD, and documentation.
  • Technical Leadership & Mentorship (15-20%) :
  • Technical Guidance : Provide technical leadership and guidance to multiple engineering teams, ensuring alignment with architectural principles and strategic goals.

  • Mentorship : Mentor senior and junior engineers, fostering their technical growth, problem-solving skills, and adherence to best practices.
  • Code Review & Quality Assurance : Lead comprehensive code reviews, ensuring high standards of code quality, efficiency, and maintainability.
  • Strategic Input : Contribute significantly to the Big Data strategy and roadmap, influencing technical decisions and long-term planning.
  • Knowledge Sharing : Drive initiatives for knowledge sharing, technical documentation, and community building within the Big Data engineering group.
  • Recruitment Support : Participate in interviewing and evaluating senior technical candidates.
  • Stakeholder Management & Client Engagement :
  • Client & Business Partner Liaison : Act as a key technical liaison between the Big Data engineering team and internal business units, product managers, and clients.

  • Requirements Gathering : Proactively engage with stakeholders to understand business requirements, pain points, and opportunities, translating them into clear, actionable technical specifications and data solutions.
  • Technical Consultation : Provide expert technical consultation and guidance to clients and business partners on Big Data capabilities, limitations, and potential solutions.
  • Query Resolution : Assist clients and internal stakeholders with complex data queries, troubleshooting data discrepancies, and providing insights derived from Big Data platforms.
  • Communication : Effectively communicate complex technical concepts, project progress, risks, and solutions to non-technical audiences, ensuring transparency and alignment.
  • Cross-Functional Collaboration : Collaborate seamlessly with other teams (e.g., architecture, data sourcing) to ensure end-to-end delivery and support of data-driven initiatives.
  • Leadership, Communication & Interpersonal Skills :
  • Exceptional problem-solving and analytical skills, with the ability to tackle highly complex technical and business challenges.

  • Strong architectural thinking and the ability to design solutions that are scalable, maintainable, and resilient.
  • Excellent verbal and written communication skills, with a proven ability to tailor technical explanations to diverse audiences, from engineers to senior business stakeholders and external clients.
  • Demonstrated ability to build consensus, manage expectations, and influence outcomes with various stakeholders.
  • Experience in mentoring and coaching other engineers.
  • Proactive, self-motivated, and able to work effectively in a fast-paced, agile environment, often juggling multiple priorities.
  • Qualifications

  • 6+ years of progressive experience in software engineering, specifically focused on designing, building, and optimizing large-scale Big Data systems.
  • Proven track record as a lead or principal engineer on significant data initiatives, demonstrating ability to drive technical projects from conception to deployment.
  • Significant experience in client-facing or business partner-facing roles, with a proven ability to manage expectations, resolve issues, and build strong relationships.
  • Experience in the financial services domain – Liquidity Management, Liquidity Stress Modelling, should be well verse with Markets terminologies. Also, experience with large data volumes, real-time processing, and stringent data quality / security requirements.
  • Deep Technical Proficiency

  • Core Big Data Frameworks : Expert-level proficiency with Apache Spark (Spark SQL, Spark Streaming, PySpark / Scala Spark), Hadoop ecosystem (HDFS, YARN).
  • Programming Languages : Expert in Scala, Python, or Java, with experience in developing robust, high-performance data processing applications.
  • Data Warehousing / Lakes : Deep understanding and practical experience with data warehouse models, and relevant technologies (e.g., Delta Lake, Iceberg, Parquet).
  • Databases : Strong proficiency in SQL; experience with NoSQL databases (e.g., Cassandra, MongoDB) is a plus.
  • DevOps & MLOps : Experience with CI / CD pipelines (e.g., Jenkins, GitLab CI), infrastructure as code (e.g., Terraform), containerization (Docker, Kubernetes / OpenShift), and monitoring tools. Familiarity with MLOps principles for data science workflows. Data Governance & Security : Solid understanding of data governance, data quality, data lineage, and data security principles in a Big Data environment.
  • Education

  • Bachelor’s degree / University degree or equivalent experience
  • Master’s degree preferred
  • This job opening is for an existing job vacancy.

    Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

    If you are a person with a disability and need a reasonable accommodation to use our search tools and / or apply for a career opportunity review Accessibility at Citi.

    View Citi’s EEO Policy Statement and the Know Your Rights poster.

    #J-18808-Ljbffr

    Create a job alert for this search

    Big Data and SQL Developer • Mississauga, Peel Region, CA

    Similar jobs
    Master Data Governance Lead (Hybrid Role)

    Master Data Governance Lead (Hybrid Role)

    KIK Consumer Products • Vaughan
    Full-time
    A leading consumer products manufacturer in Vaughan, Canada, is seeking a Master Data Management Specialist to ensure data governance and quality across multiple departments.This role combines onsi...Show more
    Last updated: 13 days ago • Promoted
    Data Architect (Contract – 12 Months)

    Data Architect (Contract – 12 Months)

    Facility Association • mississauga, ON, ca
    Full-time
    About Facility Association Are you looking to work with an organization that has an impact on the insurance industry? Do you want your voice...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer (Snowflake)

    Senior Data Engineer (Snowflake)

    RBC • Mississauga
    Full-time
    This is an opportunity to work at RBC Insurance Active Data Platform team with a group of technology specialists dedicated to delivering solutions to Insurance business and clients.We are all in wi...Show more
    Last updated: 2 days ago • Promoted
    Senior Accountant

    Senior Accountant

    Vaco by Highspring • King City, ON, CA
    Full-time
    Reconcile intercompany accounts to ensure accuracy, completeness, and timely resolution of discrepancies.Review intercompany transactions for proper counterparty identification and ensure accurate ...Show more
    Last updated: 30+ days ago • Promoted
    Statistics Private Tutoring Jobs Bond Head

    Statistics Private Tutoring Jobs Bond Head

    Superprof • Bond Head, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Set 2 Close | B Corp • burlington, ON, ca
    Full-time
    Our client is hiring an Full Stack Developer to support internal software development initiatives.The ideal candidate brings strong backend development experience, solid database...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    WellnessLiving Systems Inc. • Vaughan
    Full-time +1
    Based on experience + Benefits + Vacation.At WellnessLiving, we empower thousands of health and wellness business owners to turn their entrepreneurial dreams into reality.Our mission-critical softw...Show more
    Last updated: 13 days ago • Promoted
    Data Modeler - Hays

    Data Modeler - Hays

    Hays • mississauga, on, ca
    Full-time
    Java, SQL, Python (ETL scripting with pandas, polars, PySpark, ibis).We are looking for an experienced.The ideal candidate will have strong hands-on expertise in. ETL / ELT development, scripting.This...Show more
    Last updated: 3 days ago • Promoted
    Master Data Manager

    Master Data Manager

    Extend Information Systems Inc. • Mississauga
    Full-time
    Senior Master Data Management (MDM) Developer with Databricks Experience.We are seeking an experienced Senior MDM Developer with expertise in Databricks to join our data management team.The ideal c...Show more
    Last updated: 13 days ago • Promoted
    Master Data Coordinator - Billennium

    Master Data Coordinator - Billennium

    Billennium • mississauga, on, ca
    Full-time
    We are a Global IT Services and Solutions organization Headquartered in Poland with our local Canada office in Mississauga and other offices across the globe including Malaysia , Germany and India....Show more
    Last updated: 11 days ago • Promoted
    Senior Data Analyst, Digital

    Senior Data Analyst, Digital

    Tundra Technical Solutions • mississauga, on, ca
    Full-time
    Toronto, Ontario, 4 days on-site.Canadian Tire Corporation, Limited (“CTC”) is one of Canada’s most admired and trusted companies. With more than 90 Owned Brands, 1,700 retail locations, financial s...Show more
    Last updated: 7 days ago • Promoted
    On-Site Data Engineer — Cloud & SQL Data Systems

    On-Site Data Engineer — Cloud & SQL Data Systems

    Clientserver Tech Systems • Mississauga
    Full-time
    A technology solutions provider is seeking a Data Engineer to design and implement information systems and analyze data for business solutions. The successful applicant will work closely with client...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Altimetrik • Mississauga
    Full-time
    Direct message the job poster from Altimetrik.Design, develop, and maintain software solutions using Python.Design, develop, and maintain software solutions using. Develop Python and pyspark program...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer with Openshift exp. - Mississauga, ON - Long term contract opportunity

    Data Engineer with Openshift exp. - Mississauga, ON - Long term contract opportunity

    Zodiac Solutions • Mississauga, ON, Canada
    Full-time
    Quick Apply
    Job Title : Data Engineer with Openshift exp.Location : Mississauga, ON Job Type : Contract opportunity Our challenge <...Show more
    Last updated: 7 days ago
    Sales Representative - 60k / Year - Remote

    Sales Representative - 60k / Year - Remote

    Spade Recruiting • King, Ontario
    Remote
    Full-time
    Quick Apply
    We’re looking for enthusiastic, self-driven, individuals to assist existing and prospective clients within our organization. This position will work with multiple clients throughout the day pr...Show more
    Last updated: 5 days ago • Promoted
    Capital Markets Bigdata / Sql Developer

    Capital Markets Bigdata / Sql Developer

    Open Systems Technologies • Mississauga
    Full-time
    We are looking for a Capital Markets Big Data / SQL Developer for a hybrid contract role in Mississauga.If you possess all the required skills, please apply with an updated resume and contact details...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Accuro • Mississauga
    Full-time +1
    Job Title : Big Data Engineer with Strong SQL Exp.Location : Mississauga, ON (Hybrid / 03 days onsite).Strong Experience in Apache Hadoop, Spark, Spark SQL, Hive, Impala, Yam, Talend.Have strong exper...Show more
    Last updated: 13 days ago • Promoted
    Hair Stylist - Bradford Smart Centre

    Hair Stylist - Bradford Smart Centre

    Great Clips • BRADFORD, Ontario, Canada
    Full-time +1
    Join a locally owned Great Clips® salon, the world's largest salon brand, and be one of the GREATS! Whether you're new to the industry or have years behind the chair…great opportunities await!!.Bri...Show more
    Last updated: 27 days ago • Promoted