[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » spark » spark-introduction

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
spark:spark-introduction [2022/12/14 13:21]
straka 		spark:spark-introduction [2022/12/14 13:28] (current)
straka [Running Spark Shell in Python]
Line 5: Line 5:
 ===== Running Spark Shell in Python ===== ===== Running Spark Shell in Python =====
  
-To run interactive Python shell in local Spark mode, run (on your local workstation or on cluster using ''qrsh'' from ''lrc1'') +To run interactive Python shell in local Spark mode, run (on your local workstation or on cluster using ''srun'' from ''lrc1'') 
-  PYSPARK_DRIVER_PYTHON=ipython3 pyspark+  MASTER=local PYSPARK_DRIVER_PYTHON=ipython3 pyspark
 The PYSPARK_DRIVER_PYTHON=ipython3 parameter instructs Spark to use ''ipython3'' instead of ''python3''. The PYSPARK_DRIVER_PYTHON=ipython3 parameter instructs Spark to use ''ipython3'' instead of ''python3''.
  

[ Back to the navigation ] [ Back to the content ]