Hadoop is about so much more than MapReduce these days. This talk is a discussion of some of the new frameworks around hadoop, and how you can make best of use of Hadoop 2.0 components like YARN, as well as new complementary tools like Spark and Mesos.
Hadoop 2.0, and in particular YARN has opened up a lot of potential applications beyond MapReduce. This presentation explains some of the ways this happened, and what you can now do that you couldn’t before. It also introduces some new tools (Spark) and infrastructure pieces (Mesos) to achieve even more efficient cluster use.
This talk was first delivered at BigConf 2014 in Washington DC.