Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, May 12 • 11:15am - 12:05pm
Elastic Hadoop Clusters on Mesos with Apache Myriad (incubating) - Mohit Soni & Adam Bordelon, Mesosphere, Inc.

Sign up or log in to save this to your schedule and see who's attending!

Most datacenters today are statically partitioned into siloed clusters dedicated to run various datacenter-scale applications including web services, databases, and batch/stream processing. This static partitioning model limits overall cluster utilization, decreases flexibility and causes operational challenges. There is an increasing need to integrate Apache Hadoop big data applications with other datacenter services like Apache Spark or Apache Kafka, ideally co-locating the data with the services that need it.

In this talk Adam and Mohit will show off Apache Myriad (incubating), which integrates Apache YARN with Apache Mesos. Mesos enables efficient resource sharing and isolation across a variety of distributed applications. This allows Hadoop workloads to run alongside other datacenter applications while sharing the same cluster resources, and hence breaking silos. Myriad’s multi-tenancy strategy improves overall cluster utilization and operational efficiency, while allowing cluster operators to run multiple isolated YARN clusters on the same hardware.

Speakers
AB

Adam Bordelon

Mesosphere, Distributed System Engineer
Adam Bordelon is a distributed systems architect at Mesosphere and an Apache Mesos committer. Before joining Mesosphere, Adam lead development on Hadoop core at MapR, built distributed systems for recommendations at Amazon, and re-architected the LabVIEW compiler at National Instruments. He completed his Master’s degree at Rice University, building a tool to analyze supercomputer performance data for bottlenecks and anomalies.



Thursday May 12, 2016 11:15am - 12:05pm
Georgia B

Attendees (20)