OpenStack Summit Tokyo 2015

Video recording and production done by OpenStack Foundation.

Manila, at its core, provides basic provisioning and management of file shares to users of an OpenStack cloud. The Sahara project provides a framework to expose Big Data services such as Spark and Hadoop. Together these two projects create a solution that is greater than the sum of its parts. Natural synergy and popular demand led these three teams to develop a joint solution to expose Manila file shares within the Sahara construct to solve real Big Data challenges. This talk serves as a brief introduction to what these two projects encompass as well as a detailed look at the joint integration work that was created involving: o Sahara Data sources o Manila File Shares o Horizon Integration o Sample Workflows Some administrative enhancements to Manila will also be covered including: o Manila snapshots o NFS Connector for Hadoop o HDFS driver for Manila Finally, a demo will be presented showing a Sahara data processing job running with binaries, data sets, and results hosted in Manila file shares mounted on a Sahara cluster. Attendees will leave this session with an understanding of Manila and Sahara integrations and tangible use cases where it can be leveraged as a key component of a Big Data application deployment.

Rated: Everyone
Viewed 14 times
Tags: There are no tags for this video.