Talent.com
Big Data and SQL Developer
Big Data and SQL DeveloperPowerToFly • Mississauga, Peel Region, CA
Big Data and SQL Developer

Big Data and SQL Developer

PowerToFly • Mississauga, Peel Region, CA
Il y a 2 jours
Type de contrat
  • Temps plein
Description de poste

Overview

The Big Data and SQL Developer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Responsibilities

  • Technical Design & Implementation (60-70%) :

Architecture & Design : Lead the design and implementation of highly scalable, robust, and performant Big Data solutions, including data warehouses, streaming platforms, and analytical systems.

  • Hands-on Development : Write high-quality, production-ready code for complex data pipelines, processing frameworks, and analytical tools using languages like Scala, Python, or Java.
  • Performance Optimization : Drive performance tuning, troubleshooting, and optimization of Big Data applications and infrastructure.
  • Technical Problem Solving : Act as a go-to expert for resolving complex technical challenges across the Big Data ecosystem.
  • Innovation : Research, evaluate, and integrate new Big Data technologies and tools to enhance existing platforms and capabilities.
  • Best Practices : Champion and enforce engineering best practices, including code quality, testing, CI / CD, and documentation.
  • Technical Leadership & Mentorship (15-20%) :
  • Technical Guidance : Provide technical leadership and guidance to multiple engineering teams, ensuring alignment with architectural principles and strategic goals.

  • Mentorship : Mentor senior and junior engineers, fostering their technical growth, problem-solving skills, and adherence to best practices.
  • Code Review & Quality Assurance : Lead comprehensive code reviews, ensuring high standards of code quality, efficiency, and maintainability.
  • Strategic Input : Contribute significantly to the Big Data strategy and roadmap, influencing technical decisions and long-term planning.
  • Knowledge Sharing : Drive initiatives for knowledge sharing, technical documentation, and community building within the Big Data engineering group.
  • Recruitment Support : Participate in interviewing and evaluating senior technical candidates.
  • Stakeholder Management & Client Engagement :
  • Client & Business Partner Liaison : Act as a key technical liaison between the Big Data engineering team and internal business units, product managers, and clients.

  • Requirements Gathering : Proactively engage with stakeholders to understand business requirements, pain points, and opportunities, translating them into clear, actionable technical specifications and data solutions.
  • Technical Consultation : Provide expert technical consultation and guidance to clients and business partners on Big Data capabilities, limitations, and potential solutions.
  • Query Resolution : Assist clients and internal stakeholders with complex data queries, troubleshooting data discrepancies, and providing insights derived from Big Data platforms.
  • Communication : Effectively communicate complex technical concepts, project progress, risks, and solutions to non-technical audiences, ensuring transparency and alignment.
  • Cross-Functional Collaboration : Collaborate seamlessly with other teams (e.g., architecture, data sourcing) to ensure end-to-end delivery and support of data-driven initiatives.
  • Leadership, Communication & Interpersonal Skills :
  • Exceptional problem-solving and analytical skills, with the ability to tackle highly complex technical and business challenges.

  • Strong architectural thinking and the ability to design solutions that are scalable, maintainable, and resilient.
  • Excellent verbal and written communication skills, with a proven ability to tailor technical explanations to diverse audiences, from engineers to senior business stakeholders and external clients.
  • Demonstrated ability to build consensus, manage expectations, and influence outcomes with various stakeholders.
  • Experience in mentoring and coaching other engineers.
  • Proactive, self-motivated, and able to work effectively in a fast-paced, agile environment, often juggling multiple priorities.
  • Qualifications

  • 6+ years of progressive experience in software engineering, specifically focused on designing, building, and optimizing large-scale Big Data systems.
  • Proven track record as a lead or principal engineer on significant data initiatives, demonstrating ability to drive technical projects from conception to deployment.
  • Significant experience in client-facing or business partner-facing roles, with a proven ability to manage expectations, resolve issues, and build strong relationships.
  • Experience in the financial services domain – Liquidity Management, Liquidity Stress Modelling, should be well verse with Markets terminologies. Also, experience with large data volumes, real-time processing, and stringent data quality / security requirements.
  • Deep Technical Proficiency

  • Core Big Data Frameworks : Expert-level proficiency with Apache Spark (Spark SQL, Spark Streaming, PySpark / Scala Spark), Hadoop ecosystem (HDFS, YARN).
  • Programming Languages : Expert in Scala, Python, or Java, with experience in developing robust, high-performance data processing applications.
  • Data Warehousing / Lakes : Deep understanding and practical experience with data warehouse models, and relevant technologies (e.g., Delta Lake, Iceberg, Parquet).
  • Databases : Strong proficiency in SQL; experience with NoSQL databases (e.g., Cassandra, MongoDB) is a plus.
  • DevOps & MLOps : Experience with CI / CD pipelines (e.g., Jenkins, GitLab CI), infrastructure as code (e.g., Terraform), containerization (Docker, Kubernetes / OpenShift), and monitoring tools. Familiarity with MLOps principles for data science workflows. Data Governance & Security : Solid understanding of data governance, data quality, data lineage, and data security principles in a Big Data environment.
  • Education

  • Bachelor’s degree / University degree or equivalent experience
  • Master’s degree preferred
  • This job opening is for an existing job vacancy.

    Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

    If you are a person with a disability and need a reasonable accommodation to use our search tools and / or apply for a career opportunity review Accessibility at Citi.

    View Citi’s EEO Policy Statement and the Know Your Rights poster.

    #J-18808-Ljbffr

    Créer une alerte emploi pour cette recherche

    Big Data and SQL Developer • Mississauga, Peel Region, CA

    Offres similaires
    Data Architect (Azure)

    Data Architect (Azure)

    goeasy • Mississauga, ON, Canada
    Temps plein
    Join one of Canada’s fastest-growing companies and be part of something extraordinary – welcome to .At goeasy, our people and culture are at the heart of everything we do,...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Data Architect (Contract – 12 Months)

    Data Architect (Contract – 12 Months)

    Facility Association • mississauga, ON, ca
    Temps plein
    About Facility Association Are you looking to work with an organization that has an impact on the insurance industry? Do you want your voice...Voir plus
    Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre
    Dotnet Developer

    Dotnet Developer

    freelance.ca • Vaughan, Canada
    Temporaire
    Our client is one of the world’s leading Scientific Test and Measurement organizations.As Senior C# Developer, you’d on our client’s next-generation OS platform, focused on designing innovative fea...Voir plus
    Dernière mise à jour : il y a 19 jours • Offre sponsorisée
    Work From Home - Sales Representative - 60k / Year

    Work From Home - Sales Representative - 60k / Year

    Spade Recruiting • Tottenham, Ontario
    Télétravail
    Temps plein
    Quick Apply
    We’re looking for enthusiastic, self-driven, individuals to assist existing and prospective clients within our organization. This position will work with multiple clients throughout the day pr...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Sales Partners

    Sales Partners

    ATIA Ltd • Oakville B8B, ON, Canada
    Temps plein
    ATIA Ltd is multinational company which has 2 main sectors : .First sector : ISO Standards - which includes : .Second sector : Software Development. Developing applications for all technologies and platfo...Voir plus
    Dernière mise à jour : il y a 3 jours • Offre sponsorisée
    CEO

    CEO

    Greater Manchester Moving • Bolton C7E, ON, Canada
    Temps plein
    As the Chief Executive Officer of Bolton CVS and a Director of 10GM, you will play a central role in achieving our aim to support lasting, transformative impact for communities across Bolton and Gr...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Data Engineer

    Data Engineer

    Hays • mississauga, ON, ca
    Temps plein
    Job Title : Data Engineer- BigData and GCP Location : Toronto, ON(1day / week onsite) Duration : Contract <...Voir plus
    Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre
    Quantitative Developer

    Quantitative Developer

    Mindlance • mississauga, on, ca
    Temporaire
    Hiring : Quant Developer / Management Consultant – Capital Markets PMO.Location : Toronto, ON (4 days onsite).Job Role : We are seeking an experienced Quant Developer / Capital Markets Consultant to sup...Voir plus
    Dernière mise à jour : il y a 3 heures • Offre sponsorisée • Nouvelle offre
    Data Analyst - mississauga

    Data Analyst - mississauga

    Insight Global • mississauga, on, ca
    Temps plein
    Insight Global is seeking a highly skilled.Anti-Money Laundering (AML) strategy and analytics initiatives.This role is ideal for a technically strong candidate with a background in risk analytics, ...Voir plus
    Dernière mise à jour : il y a 3 heures • Offre sponsorisée • Nouvelle offre
    Statistics Private Tutoring Jobs Bond Head

    Statistics Private Tutoring Jobs Bond Head

    Superprof • Bond Head, Canada
    Temps plein +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Data Architect

    Data Architect

    Iris Software Inc. • mississauga, on, ca
    Temps plein
    Iris's direct client, one of the leading Fortune 500 Company, is looking to hire.Please take a look at the below mentioned job description and let me know if you would be interested.Location : Toron...Voir plus
    Dernière mise à jour : il y a 3 heures • Offre sponsorisée • Nouvelle offre
    Oracle Application Developer

    Oracle Application Developer

    VDart Inc • Mississauga, ON, Canada
    Temps plein
    Quick Apply
    Role : Oracle Application Developer Location : Mississauga, ON Contract Skills : Oracle fusion, F...Voir plus
    Dernière mise à jour : il y a 14 heures • Nouvelle offre
    Sr, Market Data Lead

    Sr, Market Data Lead

    IT Connex • mississauga, on, ca
    Temps plein
    We at it Connex are hiring Sr, Market Data lead for our global Banking clien.Data Operating Model across Markets Business Domains. This is a high-impact role requiring close collaboration with senio...Voir plus
    Dernière mise à jour : il y a 3 heures • Offre sponsorisée • Nouvelle offre
    Data Intelligence, Business Development Manager

    Data Intelligence, Business Development Manager

    Ainsworth Inc. • Woodbridge, ON, Canada
    Temps plein
    If you thrive in a team-oriented workplace that challenges your skills, to drive your career development, embraces diversity and rewards innovation, with competitive pay and great employee programs...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Hair Stylist - Bradford Smart Centre

    Hair Stylist - Bradford Smart Centre

    Great Clips • BRADFORD, Ontario, Canada
    Temps plein +1
    Join a locally owned Great Clips® salon, the world's largest salon brand, and be one of the GREATS! Whether you're new to the industry or have years behind the chair…great opportunities await!!.Bri...Voir plus
    Dernière mise à jour : il y a 11 jours • Offre sponsorisée
    Data Engineer (x4) (54540)

    Data Engineer (x4) (54540)

    Vaco by Highspring • King City, ON, CA
    Temps plein
    Our client is a leading Canadian energy organization with a strong presence across Ontario.They operate critical infrastructure that supports millions of customers and drives economic growth.Our cl...Voir plus
    Dernière mise à jour : il y a 7 jours • Offre sponsorisée
    GCP Data Engineer - BigData, Hadoop, Power BI

    GCP Data Engineer - BigData, Hadoop, Power BI

    Astra North Infoteck Inc. • Mississauga, ON, ca
    Temps plein
    Quick Apply
    Job Title : Data Engineer – GCP, BigData & Hadoop.Big Data & Hadoop Ecosystems, Google Cloud Data Engineering.Collect, process, and analyze data from multiple sources including databases, sp...Voir plus
    Dernière mise à jour : il y a 4 jours
    AWS data engineer DWIDC5725169

    AWS data engineer DWIDC5725169

    Compunnel Inc. • mississauga, on, ca
    Temps plein
    Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).Must be able to...Voir plus
    Dernière mise à jour : il y a 3 heures • Offre sponsorisée • Nouvelle offre