[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
grid [2017/10/03 14:52]
popel
grid [2017/10/03 14:55]
popel [Other]
Line 259: Line 259:
  
 ===== Other ===== ===== Other =====
-  * There is a great course [[http://ufal.mff.cuni.cz/courses/npfl102|Data intensive computing]], see the 2016 handouts if you missed the course.+  * There is a great course [[http://ufal.mff.cuni.cz/courses/npfl102|Data intensive computing]], see the 2016 handouts if you missed the course. It covers the usage of [[http://spark.apache.org/|Spark]] (MapReduce/Hadoop alternative, but better) and HDFS (Hadoop filesystem).
   * You can use environment variables ''$JOB_ID'', ''$JOB_NAME''.   * You can use environment variables ''$JOB_ID'', ''$JOB_NAME''.
   * One job can submit other jobs (but be careful with recursive:-)). A job submitted to the CPU cluster may submit GPU jobs (to the ''qpu.q'' queue).   * One job can submit other jobs (but be careful with recursive:-)). A job submitted to the CPU cluster may submit GPU jobs (to the ''qpu.q'' queue).

[ Back to the navigation ] [ Back to the content ]