Run Spark Applications As A Service In Large Scale On Kubernetes


Jun 20, 05:00 PM PDT
  • Virtual SF Big Analytics
  • 90 RSVP
Description
Speaker

This event is hosted by SF Big Analytics Group. https://www.meetup.com/SF-Big-Analytics

More and more people are running Apache Spark on Kubernetes due to the popularity of Kubernetes. There are a lot of challenges since Spark was not originally designed for Kubernetes, for example, easily submitting/managing applications, accessing Spark UI, allocating resource queues based on cpu/memory, and etc.

This talk will present how to address these challenges and provide Spark As Service in a large scale.

Bo has been working in big data area for 10+ years, and gained intensive experience of running Apache Spark in large scale while he worked in in Uber. In the Kubernetes era, he focuses on building world class Apache Spark Service, and making the tooling available to the Spark and Kubernetes communities

The event ended.
Watch Recording
*Recordings hosted on Youtube, click the link will open the Youtube page.
Contact Organizer