About the Role
As part of Workday’s Data platform team, you will be responsible for building, enhancing, and extending our Spark and Trino-based large-scale distributed data processing platform in the cloud. You will work alongside a top-notch team to architect and build features representing our:
High-velocity hybrid transactional/analytical engine
Low-latency interactive engine
Large scale cube builder engine
In this role, you will be a key driver in ensuring the platform is hardened for production at massive scale. This includes designing fault-tolerant architectures, building robust self-healing mechanisms, and implementing comprehensive telemetry to make the internal state of our distributed query engines completely transparent.
Key Responsibilities Include:
Developing data processing algorithms and techniques that work on large datasets, facilitating an interactive querying experience over large volumes of data.
Resiliency: Designing and implementing strategies for high availability, fault isolation, and graceful degradation of Spark and Trino clusters.
Observability: Building end-to-end tracing, deep metrics, and advanced alerting frameworks to proactively identify performance bottlenecks and system anomalies.
Scalability: Optimizing resource allocation, cluster auto-scaling, and multi-tenant isolation to support highly elastic and unpredictable workloads.
About You
Basic Qualification
- 8+ years of software development experience in Java and/or Scala in Linux/Unix environment.
- Experience operating large-scale distributed systems natively within public cloud environments (AWS or GCP)
- 3+ years in database internals, query processing, or distributed systems
Other Qualifications
You have a BS in Computer Science or a related field with 5 years of experience, or an MS/PhD in Computer Science, or a relevant area, with 3 years of experience.
A strong grasp of SQL and distributed data processing engines (e.g., Apache Spark).
Hands-on experience with Trino (formerly PrestoSQL) or Presto for executing fast, distributed SQL queries across large, heterogeneous data sources.
Proven experience architecting and tuning distributed systems for high availability, fault tolerance, and massive horizontal scale.
Experience implementing observability and telemetry frameworks (e.g., Prometheus, Grafana, OpenTelemetry, JMX metrics) to monitor complex distributed workloads.
Industry experience building and delivering high-performance data processing engines.
Familiarity with AI coding tools like Cursor etc
Experience leading or mentoring a team of engineers.
Workday Pay Transparency Statement
The annualized base salary ranges for the primary location and any additional locations are listed below. Workday pay ranges vary based on work location. As a part of the total compensation package, this role may be eligible for the Workday Bonus Plan or a role-specific commission/bonus, as well as annual refresh stock grants. Recruiters can share more detail during the hiring process. Each candidate’s compensation offer will be based on multiple factors including, but not limited to, geography, experience, skills, job duties, and business need, among other things. For more information regarding Workday’s comprehensive benefits, please .
Primary Location: CAN.BC.VancouverPrimary CAN Base Pay Range: $151,200 - $226,800 CADAdditional CAN Location(s) Base Pay Range: $151,200 - $226,800 CADSenior Software Engineer - Data Platform (Spark & Trino) • Vancouver, BC, Canada
Senior Software Engineer - Data Infrastructure.Marqeta is looking for a talented.You will own and deliver projects in service of quarterly goals on the team and independently identify solutions to ... Show more
Transform how software is engineered at Process Street as a Senior Software Engineer with a focus on AI SaaS.This fully remote role emphasizes creativity and technical expertise in a dynamic enviro... Show more
Expert (15+ years or niche expertise).Cyber Security portfolio within Cyber Data Risk & Resilience (CDRR).The consultant will contribute to the design, development, and modernization of secure and ... Show more
This is a high-impact engineering role with real architectural ownership.Strong programming skills in Go, Java, or Python* Proven experience designing and building distributed systems or microservi... Show more
Software Engineer, Hive – Cloudera.Location: Toronto, Ontario, Canada.At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management ... Show more
AI creators, startups, and enterprises.Our serverless approach to inference unlocks the best GPU utilization in AI infrastructure.The API gateway is managed by the Platform Team, who aim to make Fe... Show more
A technology company in Quebec is seeking a Senior Software Developer.You will be responsible for diagnosing data processing issues, ensuring software releases, and preventing data errors.Key quali... Show more
Embrace an exciting opportunity as a remote Senior Data Engineer.Lead the charge in building scalable data solutions, utilizing Databricks on AWS for impactful results.This mid-senior level positio... Show more
As a Senior Software Engineer on our Platform team, you’ll design, implement, and maintain robust, high-quality backend APIs and services.Your work will directly impact our core operations and enab... Show more
Take your engineering expertise to the next level as a Senior Software Engineer.Design event-driven systems in Python and work with cloud technologies to enrich metadata on a global scale.This posi... Show more
A leading financial technology company is seeking a Senior Engineer to design and maintain systems that empower millions of users.This role requires proven experience in financial systems and the a... Show more
Common Room is the customer intelligence platform that captures every buying signal, giving companies superpowers with AI enrichment and automation to reach the right person with the right context ... Show more
A leading data integrity firm is seeking an experienced Developer for a remote position.The ideal candidate will have over 5 years of software engineering experience and excellent troubleshooting a... Show more
A leading real estate technology company is looking for a Staff Software Engineer to enhance their data platform.This role involves building robust data pipelines, designing scalable backend servic... Show more
The engineering team at Chainalysis is inspired by solving the hardest technical challenges and creating products that build trust in cryptocurrencies.We’re a global organization with teams in the ... Show more
A leading remote work technology company seeks a Senior Software Developer to work on complex data processing and software releases.The ideal candidate will have hands-on expertise in Spark, Airflo... Show more
Transform how revenue teams operate as a Senior Engineer at Apollo.Work collaboratively in a dynamic, fast-growing SaaS environment.In your role as a Senior Software Engineer at Apollo.Collaborate ... Show more
We believe that data is the key to unleashing human potential.We've seen firsthand how data helps bridge art and science to create delightful experiences, impactful insights, and seamless automatio... Show more
A leading SMS marketing platform in Canada is looking for a Senior Backend Engineer to join their Data Platform team.In this role, you will design and maintain scalable APIs and data pipelines, col... Show more
A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications.This role involves developing applications, utilizing Databricks, and... Show more
