Video recording and production done by OpenStack Foundation.
Manila, at its core, provides basic provisioning and management of file shares to users of an OpenStack cloud. The Sahara project provides a framework to expose Big Data services such as Spark and Hadoop. Together these two projects create a solution that is greater than the sum of its parts.
Natural synergy and popular demand led these three teams to develop a joint solution to expose Manila file shares within the Sahara construct to solve real Big Data challenges.
This talk serves as a brief introduction to what these two projects encompass as well as a detailed look at the joint integration work that was created involving:
o Sahara Data sources
o Manila File Shares
o Horizon Integration
o Sample Workflows
Some administrative enhancements to Manila will also be covered including:
o Manila snapshots
o NFS Connector for Hadoop
o HDFS driver for Manila
Finally, a demo will be presented showing a Sahara data processing job running with binaries, data sets, and results hosted in Manila file shares mounted on a Sahara cluster.
Attendees will leave this session with an understanding of Manila and Sahara integrations and tangible use cases where it can be leveraged as a key component of a Big Data application deployment.