Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
spark:running-spark-on-single-machine-or-on-cluster [2014/11/10 15:01] straka |
spark:running-spark-on-single-machine-or-on-cluster [2014/11/10 17:25] straka |
||
---|---|---|---|
Line 33: | Line 33: | ||
Start Spark cluster with 10 machines 1GB RAM each and then run interactive shell. The cluster stops after the shell is exited. | Start Spark cluster with 10 machines 1GB RAM each and then run interactive shell. The cluster stops after the shell is exited. | ||
- | | + | < |
Start Spark cluster with 20 machines 512MB RAM each. The cluster has to be stopped manually using '' | Start Spark cluster with 20 machines 512MB RAM each. The cluster has to be stopped manually using '' | ||
- | | + | < |
+ | |||
+ | Note that a running Spark cluster can currently be used only from our cluster machines (connections to a running SGE Spark cluster from my workstation time-out). | ||
==== Additional SGE Options ==== | ==== Additional SGE Options ==== | ||
Additional '' | Additional '' | ||
- | | + | < |