alluxio

参考:http://www.alluxio.com/2016/04/getting-started-with-alluxio-and-spark/

环境:

ubuntu14.04 64bit

scala2.10.5

openjdk1.7

hadoop2.6

spark1.6

webui:

http://localhost:19999/home

基本功能测试:

bin/alluxio bootstrap-conf localhost
bin/alluxio format
bin/alluxio-start.sh local


bin/spark-shell
val file = sc.textFile("/in/README.txt")
file.count

file.saveAsTextFile("alluxio://localhost:19998/README.txt")
val alluxiofile = sc.textFile("alluxio://localhost:19998/README.txt")
alluxiofile.count

原文地址:https://www.cnblogs.com/catcoding/p/5402416.html