Table of Contents
MapReduce Tutorial : Setting Eclipse
This is not well tested.
If you do not like VIM, you can try using Eclipse as a Java editor. You should
- Download
/SGE/HADOOP/active/hadoop-core-1.0.1-SNAPSHOT.jar
- Download the directory
/net/projects/hadoop/java-extensions/classes
- Create a new Eclipse project that references the
hadoop-core-1.0.1-SNAPSHOT.jar
and includes all the files in/net/projects/hadoop/java-extensions/classes
. - The jar file must be copied to the UFAL cluster to be executed. If you have to input your password for every
ssh
login, you can use connection sharing and input password only once – see Connection sharing.
Instructions
Remote Execution
- Download Eclipse project on shared file system
wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz' tar -xzf eclipse-project.tar.gz
- Execute Eclipse (ufal-computer = gaia, osiris, mrblack, …)
ssh -X -Y ufal-computer.ms.mff.cuni.cz '/home/majlis/bin/eclipse'
- In Eclipse create new project (File > New > Java Project)
- Select Create project from existing source and browse to location, where files were extracted.
Local Execution
- On your local computer execute the following commands:
wget 'http://ufallab.ms.mff.cuni.cz/~majlis/eclipse-project.tar.gz' tar -xzf eclipse-project.tar.gz
- Execute Eclipse ( Applications > Programming > Eclipse 3.5.1 )
- In Eclipse create new project (File > New > Java Project)
- Select Create project from existing source and browse to location, where files were extracted.
Connection sharing
If you need to type password every time you login to UFAL network, you can use connection sharing to write it only once:
- execute
ssh -N -M -S ~/.ssh/master-%l-%r@%h:%p geri
. - while the previous
ssh
is running, you can usessh -S ~/.ssh/master-%l-%r@%h:%p geri
to log ingeri
without password.
Step 21: Preparing the environment. | Overview | Step 23: Predefined formats and types. |