ApacheCon 2016 has ended
Back To Schedule
Thursday, May 12 • 11:15am - 12:05pm
Elastic Hadoop Clusters on Mesos with Apache Myriad (incubating) - Mohit Soni & Adam Bordelon, Mesosphere, Inc.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Most datacenters today are statically partitioned into siloed clusters dedicated to run various datacenter-scale applications including web services, databases, and batch/stream processing. This static partitioning model limits overall cluster utilization, decreases flexibility and causes operational challenges. There is an increasing need to integrate Apache Hadoop big data applications with other datacenter services like Apache Spark or Apache Kafka, ideally co-locating the data with the services that need it.

In this talk Adam and Mohit will show off Apache Myriad (incubating), which integrates Apache YARN with Apache Mesos. Mesos enables efficient resource sharing and isolation across a variety of distributed applications. This allows Hadoop workloads to run alongside other datacenter applications while sharing the same cluster resources, and hence breaking silos. Myriad’s multi-tenancy strategy improves overall cluster utilization and operational efficiency, while allowing cluster operators to run multiple isolated YARN clusters on the same hardware.


Adam Bordelon

Mesosphere, Distributed System Engineer
Adam Bordelon is a distributed systems architect at Mesosphere and an Apache Mesos committer. Before joining Mesosphere, Adam lead development on Hadoop core at MapR, built distributed systems for recommendations at Amazon, and re-architected the LabVIEW compiler at National Instruments... Read More →

Thursday May 12, 2016 11:15am - 12:05pm PDT
Georgia B