Pig 0.13.0 Installation on Hadoop 2.6.0 on Ubuntu 14.04

Following Installation steps will execute successfully only when you have installed Hadoop with the help of this link. open terminal window sudo su hduser cd sudo wget http://apache-mirror.rbc.ru/pub/apache/pig/pig-0.13.0/pig-0.13.0.tar.gz sudo cp pig-0.13.0.tar.gz /usr/local/ cd /usr/local sudo tar -xvf pig-0.13.0.tar.gz sudo mv pig-0.13.0 pig sudo rm pig-0.13.0.tar.gz sudo chown hduser:hadoop -R pig Add PIG variables in bashrc … Continue reading Pig 0.13.0 Installation on Hadoop 2.6.0 on Ubuntu 14.04

Hive 1.1.1 Installation on single node hadoop 2.6.0 on ubuntu 14.04

sudo su hduser cd sudo wget http://mirror.tcpdiag.net/apache/hive/hive-1.1.1/apache-hive-1.1.1-bin.tar.gz sudo cp apache-hive-1.1.1-bin.tar.gz /usr/local/ cd /usr/local/ sudo tar -xvf apache-hive-1.1.1-bin.tar.gz sudo mv apache-hive-1.1.1-bin hive sudo chown hduser:hadoop -R hive cd sudo nano ~/.bashrc #HIVE VARIABLES START export HIVE_HOME=/usr/local/hive export PATH=$PATH:$HIVE_HOME/bin #HIVE VARIABLES END ctrl+x Y <enter> source ~/.bashrc hive if you get some error related to found class … Continue reading Hive 1.1.1 Installation on single node hadoop 2.6.0 on ubuntu 14.04

Single Node Hadoop Installation on Ubuntu 14.04

Following are the steps which should be followed in order to install Hadoop 2.6.0 on ubuntu 14.04 open terminal window -------------------------------------------------------------------------------------------------------------------------------- step 1 : install java run following commands command 1 : sudo apt-get update command 2 : sudo apt-get install default-jdk this will install JAVA in your system command 1 : javac -version command … Continue reading Single Node Hadoop Installation on Ubuntu 14.04

Hadoop Commands Example

cat => hadoop fs -cat /hdfs_home/input/abc.txt chmod => hadoop fs -chmod 777 /hdfs_home/input/abc.txt chown => hadoop fs -chown hduser:hadoop /hdfs_home/input/abc.txt copyFromLocal => hadoop fs -copyFromLocal /home/anoop/abc.txt /hdfs_home/input/ copyToLocal => hadoop fs -copyToLocal /hdfs_home/input/abc.txt /home/anoop/ cp => hadoop fs -cp /hdfs_home/input/abc.txt /hdfs_home/output/ du => hadoop fs -du /hdfs_home/input/ get => hadoop fs - get /hdfs_home/input/abc.txt /home/anoop/ … Continue reading Hadoop Commands Example