Talent.com
Data Engineer (Databricks)

Data Engineer (Databricks)

Fluent, LLCToronto, ON, CA
18 days ago
Salary
CAD100000–CAD140000 yearly
Job type
  • Remote
  • Full-time
Job description

Fluent is building the next generation advertising network, Partner Monetize & Advertiser Acquisition.  Our vision is to build an ML / AI first network of advertisers and publishers to achieve a common objective, elevating relevancy in E-commerce for everyday shoppers.

As a Data Engineer you will bring your Databricks pipeline expertise to execute on building data products to power Fluent’s business lines.  These data products will be the foundation for sophisticated data representation of customer journeys and marketplace activity.

You are known as a strong and efficient IC Data Engineer, with the ability to assist the Data Architect vetting the translation of an Enterprise Data Model to physical data models and pipelines.  You are familiar with Databricks medallion architecture, and how to work backwards from your enterprise models of Gold Data Products.  You are considered an expert in Spark.

You will work with your counterparts to build and operate high-impact data solutions.  This role is fully Remote in the Ontario, with occasional travel to NYC or Toronto offices.

Fluent is looking for an experienced Data Engineer, who thrives in writing robust code in the Databricks ecosystem.

What You’ll Do

  • Majority of the role will be software engineering – Tables, Views, Spark jobs, orchestration within Databricks environment, following an enterprise data model design.  You will help elevate standards across testing, code repository, naming conventions, etc.
  • Develop, deploy, and manage scalable pipelines on Databricks, ensuring robust integration with a Feature Store leveraging online tables for machine learning models.
  • Investigate and leverage Databricks’ capabilities to implement real-time data processing and streaming, potentially using Spark Streaming, Online Tables, Delta Live Tables.
  • Contribute and maintain the high quality of the code base with comprehensive data observability, metadata standards, and best practices.
  • Partner with data science, UI and reporting teams to understand data requirements and translate them into models.
  • Keep track of emerging tech and trends within the Databricks ecosystem
  • Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices.
  • Empower internal teams by providing communication on architecture, target gold tables, execution plans, releases and training.

Requirements

  • Bachelors or Masters degree in computer science
  • 3+ years of industry experience in Data Engineering, including expertise in Spark and SQL.
  • 1+ years of experience with Databricks environment
  • Nice to have : Familiarity with real-time ML systems within Databricks will be very beneficial
  • Benefits

    At Fluent, we like what we do and we like who we do it with. Our team is a tight-knit crew of go-getters; we love to celebrate our successes! In addition we offer a fully stocked kitchen, catered breakfast and lunch, and our office manager keeps the calendar stocked with activity-filled events. When we’re not eating, working out, or planning parties, Fluent folks can be found participating in recreational sports leagues, networking with She Runs It, and bonding across teams during quarterly outings to baseball games, fancy dinners, and pizza-making classes. And we have all the practical benefits, too…

  • Competitive compensation
  • Ample career and professional growth opportunities
  • New Headquarters with an open floor plan to drive collaboration
  • Health, dental, and vision insurance
  • Pre-tax savings plans and transit / parking programs
  • 401K with competitive employer match
  • Volunteer and philanthropic activities throughout the year
  • Educational and social events
  • The amazing opportunity to work for a high-flying performance marketing company!
  • Salary Range : $100,000 to $140,000 CAD - The base salary range represents the low and high end of the Fluent salary range for this position. Actual salaries will vary depending on factors including but not limited to location, experience, and performance.

    Fluent participates in the E-Verify Program. As a participating employer, Fluent, LLC will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS), with information from each new employee’s Form I-9 to confirm work authorization. Fluent, LLC follows all federal regulations including those set forth by The Office of Special Counsel for Immigration-Related Unfair Employment Practices (OSC). The OSC enforces the anti-discrimination provision (§ 274B) of the Immigration and Nationality Act (INA), 8 U.S.C. § 1324b.