Monthly Archives: February 2012

Grid5000 Most Used commands

Rsync Like scp, rsync is a tool for transfer of files between systems. Such tools are very useful on Grid5000, for example to synchronize your local source tree with the one on the cluster node you are using. rsync has several advantages over scp : its … Continue reading

Posted in Uncategorized | Leave a comment

Hadoop-Most Common Exceptions

Exception Exception in thread “main” java.io.IOException: Call to /IP:9000  failed on  local exception: java.io.EOFException Possible Reasons: Node on which this program was running failed to connect to namenode. Version of hadoop on server side is not  compatible with the version you use in client  side.      

Posted in Uncategorized | Leave a comment

Vim Most Used commands

Search and Replace %s/opt/usr/g Search and Replace including characters like’/’ %s/opt/usr\/local/g

Posted in Uncategorized | Leave a comment

Text Processing in Linux

Print the values in the second column of ratings.dat (:: separated) file to  movies.txt awk -v ‘FS=::’ ‘{print $2}’ ratings.dat > movies.txt Finding unique occurring lines in movies.txt sort movies.txt | uniq > movies_u.txt Split by 10 lines split -l 10 movies_u.txt Split by … Continue reading

Posted in Uncategorized | Leave a comment

SSH Login Without Password Using ssh-keygen & ssh-copy-id

ssh-keygen creates the public and private keys. ssh-copy-id copies the local-host’s public key to the remote-host’s authorized_keys file. ssh-copy-id also assigns proper permission to the remote-host’s home, ~/.ssh, and ~/.ssh/authorized_keys. Step 1: Create public and private keys using ssh-key-gen on local-host jsmith@local-host$ [Note: … Continue reading

Posted in Uncategorized | Leave a comment

Grid 5K-Good usage rules

Please try to plan large scale experiments during night-time or week-ends. Between 09:00 and 19:00 (local time of the cluster) during working days, you should not use more than the equivalent of 2 hours on all the cores of the … Continue reading

Posted in Uncategorized | Leave a comment

How to Recursively delete .svn directories

rm -rf `find . -type d -name .svn` So, this will remove every .svn folder beginning from current directory. source code: bash script #!/bin/sh echo “recursively removing .svn folders from” pwd rm -rf `find . -type d -name .svn` You … Continue reading

Posted in Uncategorized | Leave a comment