Published • 5 min read
BigDL Spark deep learning library VM now available on Microsoft Azure Marketplace
...the bigdlazrmktplc directory. Finally, test that BigDL actually works in this VM by entering the following commands: $cd bigdlazrmktplc/BigDL $export SPARK_HOME=/usr/local/spark/spark-2.2.0-bin-hadoop2.7 $export BIGDL_HOME=/home/bigdlazrmktplc/BigDL $BigDL/bin/pyspark-with-bigdl.sh --master local...the source can be found on GitHub from bigdl.util.common import * from pyspark import SparkContext from bigdl.nn.layer import * import bigdl.version # create sparkcontext with bigdl configuration sc = SparkContext.getOrCreate(conf...Launch PySpark (from BigDL directory) $bin/pyspark-with-bigdl.sh --master local[*] At the prompt, copy and paste the following code, this code can also be found...