Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
spark:spark-introduction [2022/12/14 13:21] straka |
spark:spark-introduction [2022/12/14 13:28] (current) straka [Running Spark Shell in Python] |
||
---|---|---|---|
Line 5: | Line 5: | ||
===== Running Spark Shell in Python ===== | ===== Running Spark Shell in Python ===== | ||
- | To run interactive Python shell in local Spark mode, run (on your local workstation or on cluster using '' | + | To run interactive Python shell in local Spark mode, run (on your local workstation or on cluster using '' |
- | PYSPARK_DRIVER_PYTHON=ipython3 pyspark | + | |
The PYSPARK_DRIVER_PYTHON=ipython3 parameter instructs Spark to use '' | The PYSPARK_DRIVER_PYTHON=ipython3 parameter instructs Spark to use '' | ||