Loading…
NOTE: The event will be held in Central Daylight Time (CDT), UTC -5.

View More Details for Open Source Summit + Embedded Linux Conference North America 2020
Registration Information.
Back To Schedule
Wednesday, July 1 • 3:05pm - 3:55pm
Flyte: Cloud Native Machine Learning & Data Processing Platform - Ketan Umare & Matthew Smith, Lyft

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Flyte is the backbone for large-scale Machine Learning and Data Processing (ETL) pipelines at Lyft. It is used across business critical applications ranging from ETA, Pricing, Mapping, Autonomous etc. At its core it is a Kubernetes native workflow engine that executes 40M+ containers per month as part of ~1M pipeline executions. Flyte also helps Lyft orchestrate more than 300k Spark workloads a month. We introduced Flyte at Kubecon 2019. This talk will build on the base talk and dive deeper into the architecture and the developer experience. Thus the talk will help existing users of Flyte and new users as well.

  • Quick overview of Flyte concepts
  • Architecture of Flyte
  • How we overcame various challenges to scale Kubernetes for stateful workloads.
  • Provide an indepth look at building a real time forecasting platform @Lyft on top of Flyte. 
  • We will try to conclude with a demo 

Speakers
avatar for Ketan Umare

Ketan Umare

Senior Staff Software Engineer, Lyft
Ketan Umare is a senior staff software engineer at Lyft and founder of the Flyte project. Before Flyte he worked on ETA, routing and mapping infrastructure at Lyft. He is also the founder of Flink Kubernetes operator and contributor to Spark on K8s. Prior to Lyft he was a founding... Read More →
MS

Matthew Smith

Staff Software Engineer, Lyft
Matt leads the Flyte Applications and Frameworks team at Lyft and has been working on Flyte since it’s inception three years ago. His focus is largely on developer ergonomics and expanding the Flyte APIs for Lyft’s--and the industry’s--multivariate workflow needs in data and... Read More →



Wednesday July 1, 2020 3:05pm - 3:55pm CDT
AI/ML/DL Theater