[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
courses:mapreduce-tutorial:step-22 [2012/01/28 00:26]
straka
courses:mapreduce-tutorial:step-22 [2012/01/31 10:46] (current)
majlis Instructions for remote execution were added.
Line 7: Line 7:
   - Download the directory ''/net/projects/hadoop/java-extensions/classes''   - Download the directory ''/net/projects/hadoop/java-extensions/classes''
   - Create a new Eclipse project that references the ''hadoop-core-1.0.1-SNAPSHOT.jar'' and includes all the files in ''/net/projects/hadoop/java-extensions/classes''.   - Create a new Eclipse project that references the ''hadoop-core-1.0.1-SNAPSHOT.jar'' and includes all the files in ''/net/projects/hadoop/java-extensions/classes''.
-  - The jar file must be copied to the UFAL cluster to be executed. If you have to input your password for every ''ssh'' login, you can use connection sharing and input password only once -- ask for help if you need this.+  - The jar file must be copied to the UFAL cluster to be executed. If you have to input your password for every ''ssh'' login, you can use connection sharing and input password only once -- see [[step-22#Connection sharing]]. 
 + 
 +===== Instructions ===== 
 + 
 +==== Remote Execution ==== 
 +  * Download Eclipse project on shared file system 
 + 
 +  wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz' 
 +  tar -xzf eclipse-project.tar.gz 
 + 
 +  * Execute Eclipse (ufal-computer = gaia, osiris, mrblack, ...) 
 + 
 +  ssh -X -Y ufal-computer.ms.mff.cuni.cz '/home/majlis/bin/eclipse' 
 + 
 +  * In Eclipse create new project (File > New > Java Project) 
 +    * Select //Create project from existing source// and browse to location, where files were extracted.   
 + 
 +==== Local Execution ==== 
 +  * On your local computer execute the following commands: 
 + 
 +  wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz' 
 +  tar -xzf eclipse-project.tar.gz 
 + 
 + 
 +  * Execute Eclipse ( Applications > Programming > Eclipse 3.5.1 ) 
 +  * In Eclipse create new project (File > New > Java Project) 
 +    * Select //Create project from existing source// and browse to location, where files were extracted. 
 + 
 + 
 +===== Connection sharing ===== 
 + 
 +If you need to type password every time you login to UFAL network, you can use connection sharing to write it only once: 
 +  * execute ''ssh -N -M -S ~/.ssh/master-%l-%r@%h:%p geri''
 +  * while the previous ''ssh'' is running, you can use ''ssh -S ~/.ssh/master-%l-%r@%h:%p geri'' to log in ''geri'' without password. 
 + 
 +---- 
 + 
 +<html> 
 +<table style="width:100%"> 
 +<tr> 
 +<td style="text-align:left; width: 33%; "></html>[[step-21|Step 21]]: Preparing the environment.<html></td> 
 +<td style="text-align:center; width: 33%; "></html>[[.|Overview]]<html></td> 
 +<td style="text-align:right; width: 33%; "></html>[[step-23|Step 23]]: Predefined formats and types.<html></td> 
 +</tr> 
 +</table> 
 +</html>

[ Back to the navigation ] [ Back to the content ]