Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
spark:running-spark-on-single-machine-or-on-cluster [2022/12/14 12:54] straka [Memory Specification] |
spark:running-spark-on-single-machine-or-on-cluster [2022/12/14 12:58] straka [Examples] |
||
---|---|---|---|
Line 35: | Line 35: | ||
==== Examples ==== | ==== Examples ==== | ||
- | Start Spark cluster with 10 machines 1GB RAM each and then run interactive shell. The cluster stops after the shell is exited. | + | Start Spark cluster with 10 workers 2GB RAM each and then run interactive shell. The cluster stops after the shell is exited. |
- | < | + | < |
- | Start Spark cluster with 20 machines 512MB RAM each. The cluster has to be stopped manually | + | Start Spark cluster with 20 workers 4GB RAM each in the '' |
- | < | + | < |
- | Note that a running Spark cluster can currently be used only from other cluster machines (connections to a running SGE Spark cluster from my workstation ends with timeout). | ||
==== Additional SGE Options ==== | ==== Additional SGE Options ==== |