Loading…
This event has ended. Visit the official site or create your own event on Sched.
Customize your schedule by session topic and skill level:  Session Topic - Refer to the "Type" filter list to the right to find a session based on topic. Talk Difficulty - Sessions are categorized as [B]eginner, [I]ntermediate or [A]dvanced at the end of each talk title.
View analytic
Thursday, March 30 • 14:45 - 15:20
BoFs: Data-Aware Scheduling in Kubernetes [I] - Johannes M. Scheuermann, inovex & Felix Hupfeld, Quobyte

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
In order to provide prompt results and efficiently deal with data-intensive workloads, Big Data applications execute their jobs on compute slots across large clusters. Also, for optimal performance, these applications should be as close as possible to the data they use. Data-aware scheduling is the way to achieve that optimization and can conveniently be set up using Kubernetes. We’ll present two different use cases: First, we’ll make use of how Big Data applications like Hadoop and Spark can use their native HDFS protocol for data-aware scheduling. Second, we’ll demonstrate an efficient way to write a data-aware scheduler for Kubernetes that satisfies not just your application’s requirements, but also keeps your admins happy. As a bonus, it’ll also allows us to run data-aware scheduling on applications other than Big Data.

Speakers
FH

Felix Hupfeld

Founder, Quobyte
Felix manages Quobyte’s technology and pushes development forward. Before that, he worked as a tech lead and capacity planner in Google’s infrastructure team (2009–2013). He was the architect and project manager for XtreemFS (2006–2009). Felix’s PhD was on distributed storage.
avatar for Johannes M. Scheuermann

Johannes M. Scheuermann

Cloud Platform Engineer, inovex GmbH
Johannes is an operations guy with a software development background. He's been working with Containers and Kubernetes for over years. He has a strong interest in modern infrastructures and building infrastructure software.



Thursday March 30, 2017 14:45 - 15:20
A 03 Berlin Congress Center, Alexanderstraße 11, 10178 Berlin, Germany