hadooppig.net
Niftyクラウド環境の構築(4)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/61
Hadoop 175.184.120.0/24(ro,all squash,sync) を追加する. Hadoop 172.16.1.0/24(ro,all squash,sync) を追加する プライベートLAN. ポートマップ起動 ない場合は、yum -y install portmap. Etc/rc.d/init.d/portmap start. Etc/rc.d/init.d/nfs start. 起動時に portmap または rpcbind を起動する. Chkconfig –list portmap. 0:off 1:off 2:on 3:on 4:on 5:on 6:off. Chkconfig –list nfs. 0:off 1:off 2:on 3:on 4:on 5:on 6:off. Cdh00 – copy – CDHbase-01. The document has moved here.
hadooppig.net
システムエンジニアが開放される方法-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/top
The document has moved here.
hadooppig.net
Niftyクラウド環境の構築(9)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/78
Yum groupinstall “X Window System” “GNOME Desktop Environment”. Run levelの変更は /etc/inittab で行う。 The document has moved here.
hadooppig.net
Niftyクラウド環境の構築(14)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/105
Cdh00 /hadoop/conf.nfs/hdfs-site.xml. Data/dfs/name - /hdfs area/dfs/name. Data/dfs/data - /hdfs area/dfs/data. Cdh00 /hadoop/conf.nfs/mapred-site.xml. Data/mapred/local - /hdfs area/mapred/local. Chown -R hdfs:hadoop /hdfs disk1. Chown -R hdfs:hadoop /var/run/hadoop. Chmod 777 /hdfs disk1. Rm -rf /hdfs disk1/*. Mkdir -p /hdfs disk1/dfs/name /hdfs area/dfs/data. Chown -R hdfs:hadoop /hdfs disk1/dfs/name /hdfs disk1/dfs/data. Chmod -R 700 /hdfs disk1/dfs/name/. Chmod -R 755 /hdfs disk1/dfs/data/.
hadooppig.net
Niftyクラウド環境の構築(18)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/118
Mkdir -p /hdfs disk1/dfs/name /hdfs disk1/dfs/data. Chown -R hdfs:hadoop /hdfs disk1/dfs/name/ /hdfs disk1/dfs/data/. Chmod -R 700 /hdfs disk1/dfs/name/. Chmod -R 755 /hdfs disk1/dfs/data/. Mkdir -p /hdfs disk1/mapred/local. Chown -R mapred:hadoop /hdfs disk1/mapred/local/. Chmod -R 755 /hdfs disk1/mapred/local/. IPADDR=172.29.216.10x. NETMASK=255.255.255.0. The document has moved here.
hadooppig.net
Niftyクラウド環境の構築(11)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/84
Service hadoop-0.20-namenode status. Service hadoop-0.20-jobtracker status. Service hadoop-0.20-datanode status. Service hadoop-0.20-tasktracker status. Hadoop fs -ls /. Drwxr-xr-x – hdfs supergroup 0 2012-01-27 19:40 /KR. Drwxr-xr-x – hdfs supergroup 0 2012-01-27 20:05 /hadoop. Drwx—— – mapred supergroup 0 2012-01-27 20:05 /mapred. Drwxr-xr-x – hdfs supergroup 0 2012-01-27 20:05 /user. Rw-r–r– 1 root root 1354189115 4月 26 2011 KR200910s.LOG. Rw-r–r– 1 root root 709788916 6月 23 2011 SH201003s...Rw-r̵...
hadooppig.net
Niftyクラウド環境の構築(2)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/57
Echo “export JAVA HOME=/usr/java/latest” /etc/bashrc. 確認 echo $JAVA HOME. Wget http:/ archive.cloudera.com/redhat/cdh/cloudera-cdh3.repo. Cp cloudera-cdh3.repo /etc/yum.repos.d/. Yum install hadoop-0.20. Yum install hadoop-0.20-namenode. Yum install hadoop-0.20-datanode. Yum install hadoop-0.20-secondarynamenode. Yum install hadoop-0.20-jobtracker. Yum install hadoop-0.20-tasktracker. The document has moved here.
hadooppig.net
Niftyクラウド環境の構築(10)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/80
Mount -t nfs 175.184.120.108:/hadoop /mnt/hadoop. Service hadoop-0.20-datanode status. Service hadoop-0.20-tasktracker status. Mkdir -p /data/dfs/name /data/dfs/data /data/mapred/local. Chown -R hdfs:hadoop /data/dfs/name /data/dfs/data. Chown -R mapred:hadoop /data/mapred/local. Chmod -R 700 /data/dfs/name/. Chmod -R 755 /data/dfs/data/. Chmod -R 755 /data/mapred/local/. Hadoop fs -mkdir /mapred/system. Hadoop fs -chown -R mapred:supergroup /mapred. Hadoop fs -chown -R mapred:hadoop /mapred.
hadooppig.net
Niftyクラウド環境の構築(6)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/72
Root@Vine root]# vi /etc/fstab. 175184.120.108:/hadoop /mnt/hadoop nfs rw 0 0. Mv core-site.xml core-site.org. Ln -s /mnt/hadoop/conf.nfs/core-site.xml core-site.xml. Mv hdfs-site.xml hdfs-site.org. Ln -s /mnt/hadoop/conf.nfs/hdfs-site.xml hdfs-site.xml. Mv mapred-site.xml mapred-site.org. Ln -s /mnt/hadoop/conf.nfs/mapred-site.xml mapred-site.xml. The document has moved here.
hadooppig.net
Niftyクラウド環境の構築(17)-Hadoop/Pig をクラウドで活かすには
http://hadooppig.net/archives/114
2 領域作成 例 /dev/sdb. コマンド: p 領域テーブルを表示 デバイス名を確認する mkfsで使用する 例 /dev/sdb1. Mkfs -t ext3 /dev/sdb1. Dev/sdb1 /hdfs disk1 ext3 defaults 1 2. Mount /dev/sdb1 /hdfs disk1. The document has moved here.