[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » courses » mapreduce-tutorial » step-22

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
courses:mapreduce-tutorial:step-22 [2012/01/30 16:06]
majlis 		courses:mapreduce-tutorial:step-22 [2012/01/31 10:46] (current)
majlis Instructions for remote execution were added.
Line 7: Line 7:
   - Download the directory ''/net/projects/hadoop/java-extensions/classes''   - Download the directory ''/net/projects/hadoop/java-extensions/classes''
   - Create a new Eclipse project that references the ''hadoop-core-1.0.1-SNAPSHOT.jar'' and includes all the files in ''/net/projects/hadoop/java-extensions/classes''.   - Create a new Eclipse project that references the ''hadoop-core-1.0.1-SNAPSHOT.jar'' and includes all the files in ''/net/projects/hadoop/java-extensions/classes''.
-  - The jar file must be copied to the UFAL cluster to be executed. If you have to input your password for every ''ssh'' login, you can use connection sharing and input password only once -- ask for help if you need this.+  - The jar file must be copied to the UFAL cluster to be executed. If you have to input your password for every ''ssh'' login, you can use connection sharing and input password only once -- see [[step-22#Connection sharing]].
  
 ===== Instructions ===== ===== Instructions =====
 +
 +==== Remote Execution ====
 +  * Download Eclipse project on shared file system
 +
 +  wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz'
 +  tar -xzf eclipse-project.tar.gz
 +
 +  * Execute Eclipse (ufal-computer = gaia, osiris, mrblack, ...)
 +
 +  ssh -X -Y ufal-computer.ms.mff.cuni.cz '/home/majlis/bin/eclipse'
 +
 +  * In Eclipse create new project (File > New > Java Project)
 +    * Select //Create project from existing source// and browse to location, where files were extracted.  
 +
 +==== Local Execution ====
   * On your local computer execute the following commands:   * On your local computer execute the following commands:
  
-  mkdir -p hadoop; cd hadoop 
   wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz'   wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz'
   tar -xzf eclipse-project.tar.gz   tar -xzf eclipse-project.tar.gz
Line 20: Line 34:
   * In Eclipse create new project (File > New > Java Project)   * In Eclipse create new project (File > New > Java Project)
     * Select //Create project from existing source// and browse to location, where files were extracted.     * Select //Create project from existing source// and browse to location, where files were extracted.
 +
 +
 +===== Connection sharing =====
 +
 +If you need to type password every time you login to UFAL network, you can use connection sharing to write it only once:
 +  * execute ''ssh -N -M -S ~/.ssh/master-%l-%r@%h:%p geri''.
 +  * while the previous ''ssh'' is running, you can use ''ssh -S ~/.ssh/master-%l-%r@%h:%p geri'' to log in ''geri'' without password.
  
 ---- ----

[ Back to the navigation ] [ Back to the content ]