CentOS 7下安裝集群HBase1.2.4
來(lái)源 :https://my.oschina.net/xhhuang/blog/809210
注意:在進(jìn)行HBase集群配置前一定要配置集群時(shí)間同步,不然當(dāng)集群中各節(jié)點(diǎn)時(shí)間差異過大時(shí)會(huì)導(dǎo)致HBase集群無(wú)法啟動(dòng)。
一、準(zhǔn)備工作
1)下載HBase-1.2.4
在終端上使用如下命令下載,注意下載帶有bin的這個(gè)版本,不要下載帶有src的這個(gè)版本,hbase官網(wǎng)有說(shuō)明:
wget http://archive.apache.org/dist/hbase/stable/hbase-1.2.4-bin.tar.gz
2)解壓hbase-1.2.4-bin.tar.gz到/home/hbase-1.2.4目錄下,此處不再做演示,請(qǐng)參考前兩篇博文。
3)在hbase-1.2.4/目錄下創(chuàng)建以下目錄
mkdir /home/hadoop/hbase-1.2.4/logs
mkdir /home/hadoop/hbase-1.2.4/pids
mkdir /home/hadoop/hbase-1.2.4/tmp
二、配置HBase
1)修改hbase-1.2.4/conf/hbase-env.sh文件
添加如下兩行:
export JAVA_HOME=/usr/java/jdk1.8.0_112
export HBASE_MANAGES_ZK=false
export HBASE_LOG_DIR=/home/hadoop/hbase-1.2.4/logs
export HBASE_PID_DIR=/home/hadoop/hbase-1.2.4/pids
2)修改hbase-1.2.4/conf/hbase-site.xml文件
注意:官網(wǎng)上給的是hbase.rootdir,但是在實(shí)踐中,該名稱會(huì)導(dǎo)致使用hbase shell時(shí)報(bào)錯(cuò),因此需要改為hbase.root.dir
hbase.root.dir
hdfs://master:9000/hbase
hbase.cluster.distributed
true
hbase.tmp.dir
file:///home/hadoop/hbase-1.2.4/tmp
hbase.zookeeper.quorum
master,slave1,slave2
hbase.master
hdfs://master:60000
3)用hadoop-2.7.3和zookeeper-3.4.9相關(guān)jar文件替換hbase-1.2.4/lib目錄下的hadoop*.jar和zookeeper*.jar。建議對(duì)著hbase-1.2.4/lib目錄下的hadoop*.jar和zookeeper*.jar的文件,去hadoop-2.7.3和zookeeper-3.4.9里面找,然后替換。
下面兩幅圖展示了所有hbase-1.2.4/lib目錄下的hadoop*.jar和zookeeper*.jar文件,我們只需要用自己所用版本的hadoop和zookeeper里面的相關(guān)文件替換即可。
(注:hadoop-client-2.5.1.jar這個(gè)包在hadoop-2.7.3中是沒有的,所以這個(gè)不用替換,直接刪除即可)
4)修改regionservers中的值
master
slave1
slave2
5)將/home/hadoop/hbase-1.2.4目錄里面所有內(nèi)容拷貝至其他節(jié)點(diǎn)
scp -r /home/hadoop/hbase-1.2.4 hadoop@slave1:/home/hadoop/
scp -r /home/hadoop/hbase-1.2.4 hadoop@slave2:/home/hadoop/
5)master上啟動(dòng)HBase集群
在master上的hbase-1.2.4/bin目錄下,執(zhí)行以下命令啟動(dòng)HBase集群
./start-hbase.sh
啟動(dòng)后要觀察以下現(xiàn)象:
在每個(gè)節(jié)點(diǎn)上使用jps命令查看master上是否有HMaster進(jìn)程,所有的slaves節(jié)點(diǎn)上是否有HRegionServer進(jìn)程在master上,通過master:16010網(wǎng)址查看hbase集群相關(guān)情況,如下圖所示:三、說(shuō)明
在配置hbase的過程中,遇到了一個(gè)問題,查看master和slaves的log日志發(fā)現(xiàn)是由于在替換jar文件時(shí)未替換完全,此處把相關(guān)的log日志貼出來(lái):
master端:
Mon Dec 19 21:17:46 HKT 2016 Starting master on master
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 63290
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 4096
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
2016-12-19 21:17:47,269 INFO [main] util.VersionInfo: HBase 1.2.4
2016-12-19 21:17:47,270 INFO [main] util.VersionInfo: Source code repository git://asf-dev/home/busbey/projects/hbase revision=67592f3d062743907f8c5ae00dbbe1ae4f69e5af
2016-12-19 21:17:47,270 INFO [main] util.VersionInfo: Compiled by busbey on Tue Oct 25 18:10:20 CDT 2016
2016-12-19 21:17:47,270 INFO [main] util.VersionInfo: From source with checksum b45f19b5ac28d9651aa2433a5fa33aa0
2016-12-19 21:17:47,609 INFO [main] util.ServerCommandLine: env:PATH=/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:/usr/java/jdk1.8.0_112/bin:/usr/java/jdk1.8.0_112/jre/bin:/home/hadoop/hadoop-2.7.3/bin:/home/hadoop/hadoop-2.7.3/sbin:/home/hadoop/zookeeper-3.4.9/bin:/home/hadoop/hbase-1.2.4/bin:/home/hadoop/hive-2.1.1/bin:/home/hadoop/.local/bin:/home/hadoop/bin
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:XAUTHORITY=/run/gdm/auth-for-hadoop-oDtPGQ/database
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:IMSETTINGS_MODULE=none
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:XMODIFIERS=@im=ibus
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/home/hadoop/hbase-1.2.4/pids
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:GDMSESSION=gnome-classic
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:PermSize=128m -XX:MaxPermSize=128m
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-KM6064D66O,guid=d213048e27fd2282cef338bc5857d7e7
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:XDG_CURRENT_DESKTOP=GNOME-Classic:GNOME
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:JRE_HOME=/usr/java/jdk1.8.0_112/jre
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hadoop
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:SSH_AGENT_PID=3288
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=:/home/hadoop/hadoop-2.7.3/lib/native
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:SESSION_MANAGER=local/unix:@/tmp/.ICE-unix/3134,unix/unix:/tmp/.ICE-unix/3134
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:USERNAME=hadoop
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:LOGNAME=hadoop
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS=
2016-12-19 21:17:47,610 INFO [main] util.ServerCommandLine: env:PWD=/home/hadoop/hbase-1.2.4/bin
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:WINDOWID=35651591
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:HIVE_HOME=/home/hadoop/hive-2.1.1
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -XX:PermSize=128m -XX:MaxPermSize=128m
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:GNOME_DESKTOP_SESSION_ID=this-is-deprecated
2016-12-19 21:17:47,611 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/home/hadoop/hadoop-2.7.3
2016-12-19 21:17:47,613 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:IMSETTINGS_INTEGRATE_DESKTOP=yes
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-XX:+UseConcMarkSweepGC -XX:PermSize=128m -XX:MaxPermSize=128m -Dhbase.log.dir=/home/hadoop/hbase-1.2.4/logs -Dhbase.log.file=hbase-hadoop-master-master.log -Dhbase.home.dir=/home/hadoop/hbase-1.2.4 -Dhbase.id.str=hadoop -Dhbase.root.logger=INFO,RFA -Djava.library.path=/home/hadoop/hadoop-2.7.3/lib/native -Dhbase.security.logger=INFO,RFAS
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:HBASE_START_FILE=/home/hadoop/hbase-1.2.4/pids/hbase-hadoop-master.autorestart
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:XDG_SESSION_DESKTOP=gnome-classic
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:LS_COLORS=rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;34:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.Z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.axv=38;5;13:*.anx=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.axa=38;5;45:*.oga=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:SHLVL=5
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/home/hadoop/zookeeper-3.4.9
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hadoop-master-master.log
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:QT_IM_MODULE=ibus
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/java/jdk1.8.0_112
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:TERM=xterm-256color
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=2
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:DISPLAY=:0
2016-12-19 21:17:47,614 INFO [main] util.ServerCommandLine: env:GDM_LANG=en_US.UTF-8
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hadoop
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/home/hadoop/hbase-1.2.4/pids/hbase-hadoop-master.znode
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hadoop-master-master
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:DESKTOP_SESSION=gnome-classic
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/home/hadoop/hbase-1.2.4/logs
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:GPG_AGENT_INFO=/run/user/1000/keyring/gpg:0:1
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:USER=hadoop
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:CLASSPATH=/home/hadoop/hbase-1.2.4/conf:/usr/java/jdk1.8.0_112/lib/tools.jar:/home/hadoop/hbase-1.2.4:/home/hadoop/hbase-1.2.4/lib/activation-1.1.jar:/home/hadoop/hbase-1.2.4/lib/aopalliance-1.0.jar:/home/hadoop/hbase-1.2.4/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hbase-1.2.4/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hbase-1.2.4/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hbase-1.2.4/lib/api-util-1.0.0-M20.jar:/home/hadoop/hbase-1.2.4/lib/asm-3.1.jar:/home/hadoop/hbase-1.2.4/lib/avro-1.7.4.jar:/home/hadoop/hbase-1.2.4/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase-1.2.4/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase-1.2.4/lib/commons-cli-1.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-codec-1.9.jar:/home/hadoop/hbase-1.2.4/lib/commons-collections-3.2.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-compress-1.4.1.jar:/home/hadoop/hbase-1.2.4/lib/commons-configuration-1.6.jar:/home/hadoop/hbase-1.2.4/lib/commons-daemon-1.0.13.jar:/home/hadoop/hbase-1.2.4/lib/commons-digester-1.8.jar:/home/hadoop/hbase-1.2.4/lib/commons-el-1.0.jar:/home/hadoop/hbase-1.2.4/lib/commons-httpclient-3.1.jar:/home/hadoop/hbase-1.2.4/lib/commons-io-2.4.jar:/home/hadoop/hbase-1.2.4/lib/commons-lang-2.6.jar:/home/hadoop/hbase-1.2.4/lib/commons-logging-1.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-math-2.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-math3-3.1.1.jar:/home/hadoop/hbase-1.2.4/lib/commons-net-3.1.jar:/home/hadoop/hbase-1.2.4/lib/disruptor-3.3.0.jar:/home/hadoop/hbase-1.2.4/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/hbase-1.2.4/lib/guava-12.0.1.jar:/home/hadoop/hbase-1.2.4/lib/guice-3.0.jar:/home/hadoop/hbase-1.2.4/lib/guice-servlet-3.0.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-common-2.7.3-tests.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-hdfs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-hdfs-2.7.3-tests.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-hdfs-nfs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-app-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-core-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-hs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-jobclient-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-shuffle-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-examples-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-nfs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-api-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-applications-distributedshell-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-client-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-registry-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-nodemanager-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-resourcemanager-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-tests-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-web-proxy-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hbase-annotations-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-annotations-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-client-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-common-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-common-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-examples-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-external-blockcache-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-hadoop2-compat-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-hadoop-compat-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-it-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-it-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-prefix-tree-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-procedure-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-protocol-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-resource-bundle-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-rest-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-server-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-server-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-shell-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-thrift-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/hbase-1.2.4/lib/httpclient-4.2.5.jar:/home/hadoop/hbase-1.2.4/lib/httpcore-4.4.1.jar:/home/hadoop/hbase-1.2.4/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jackson-xc-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jamon-runtime-2.4.1.jar:/home/hadoop/hbase-1.2.4/lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase-1.2.4/lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase-1.2.4/lib/javax.inject-1.jar:/home/hadoop/hbase-1.2.4/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hbase-1.2.4/lib/jaxb-api-2.2.2.jar:/home/hadoop/hbase-1.2.4/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase-1.2.4/lib/jcodings-1.0.8.jar:/home/hadoop/hbase-1.2.4/lib/jersey-client-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-core-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-guice-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-json-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-server-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jets3t-0.9.0.jar:/home/hadoop/hbase-1.2.4/lib/jettison-1.3.3.jar:/home/hadoop/hbase-1.2.4/lib/jetty-6.1.26.jar:/home/hadoop/hbase-1.2.4/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hbase-1.2.4/lib/jetty-util-6.1.26.jar:/home/hadoop/hbase-1.2.4/lib/joni-2.1.2.jar:/home/hadoop/hbase-1.2.4/lib/jruby-complete-1.6.8.jar:/home/hadoop/hbase-1.2.4/lib/jsch-0.1.42.jar:/home/hadoop/hbase-1.2.4/lib/jsp-2.1-6.1.14.jar:/home/hadoop/hbase-1.2.4/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/hbase-1.2.4/lib/junit-4.12.jar:/home/hadoop/hbase-1.2.4/lib/leveldbjni-all-1.8.jar:/home/hadoop/hbase-1.2.4/lib/libthrift-0.9.3.jar:/home/hadoop/hbase-1.2.4/lib/log4j-1.2.17.jar:/home/hadoop/hbase-1.2.4/lib/metrics-core-2.2.0.jar:/home/hadoop/hbase-1.2.4/lib/netty-all-4.0.23.Final.jar:/home/hadoop/hbase-1.2.4/lib/paranamer-2.3.jar:/home/hadoop/hbase-1.2.4/lib/protobuf-java-2.5.0.jar:/home/hadoop/hbase-1.2.4/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/hbase-1.2.4/lib/servlet-api-2.5.jar:/home/hadoop/hbase-1.2.4/lib/slf4j-api-1.7.7.jar:/home/hadoop/hbase-1.2.4/lib/slf4j-log4j12-1.7.5.jar:/home/hadoop/hbase-1.2.4/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hbase-1.2.4/lib/spymemcached-2.11.6.jar:/home/hadoop/hbase-1.2.4/lib/xmlenc-0.52.jar:/home/hadoop/hbase-1.2.4/lib/xz-1.0.jar:/home/hadoop/hbase-1.2.4/lib/zookeeper-3.4.9.jar:/home/hadoop/hadoop-2.7.3/etc/hadoop:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/*:/home/hadoop/hadoop-2.7.3/share/hadoop/common/*:/home/hadoop/hadoop-2.7.3/share/hadoop/hdfs:/home/hadoop/hadoop-2.7.3/share/hadoop/hdfs/lib/*:/home/hadoop/hadoop-2.7.3/share/hadoop/hdfs/*:/home/hadoop/hadoop-2.7.3/share/hadoop/yarn/lib/*:/home/hadoop/hadoop-2.7.3/share/hadoop/yarn/*:/home/hadoop/hadoop-2.7.3/share/hadoop/mapreduce/lib/*:/home/hadoop/hadoop-2.7.3/share/hadoop/mapreduce/*:/home/hadoop/hadoop-2.7.3/contrib/capacity-scheduler/*.jar
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:XDG_MENU_PREFIX=gnome-
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:WINDOWPATH=1
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:VTE_VERSION=3803
2016-12-19 21:17:47,615 INFO [main] util.ServerCommandLine: env:XDG_SEAT=seat0
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:HOSTNAME=master
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:GNOME_SHELL_SESSION_MODE=classic
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:XDG_RUNTIME_DIR=/run/user/1000
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS=
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/home/hadoop/hbase-1.2.4
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:XDG_VTNR=1
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:HOME=/home/hadoop
2016-12-19 21:17:47,616 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4
2016-12-19 21:17:47,618 INFO [main] util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.112-b15
2016-12-19 21:17:47,618 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_master, -XX:OnOutOfMemoryError=kill -9 %p, -XX:+UseConcMarkSweepGC, -XX:PermSize=128m, -XX:MaxPermSize=128m, -Dhbase.log.dir=/home/hadoop/hbase-1.2.4/logs, -Dhbase.log.file=hbase-hadoop-master-master.log, -Dhbase.home.dir=/home/hadoop/hbase-1.2.4, -Dhbase.id.str=hadoop, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=/home/hadoop/hadoop-2.7.3/lib/native, -Dhbase.security.logger=INFO,RFAS]
2016-12-19 21:17:47,982 INFO [main] regionserver.RSRpcServices: master/master/59.71.229.189:16000 server-side HConnection retries=350
2016-12-19 21:17:48,117 INFO [main] ipc.SimpleRpcScheduler: Using deadline as user call queue, count=3
2016-12-19 21:17:48,134 INFO [main] ipc.RpcServer: master/master/59.71.229.189:16000: started 10 reader(s) listening on port=16000
2016-12-19 21:17:48,214 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties
2016-12-19 21:17:48,306 INFO [main] impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2016-12-19 21:17:48,306 INFO [main] impl.MetricsSystemImpl: HBase metrics system started
2016-12-19 21:17:48,832 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks
2016-12-19 21:17:49,037 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=master:16000 connecting to ZooKeeper ensemble=master:2181,slave1:2181,slave2:2181
2016-12-19 21:17:49,043 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT
2016-12-19 21:17:49,043 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=master
2016-12-19 21:17:49,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_112
2016-12-19 21:17:49,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2016-12-19 21:17:49,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.8.0_112/jre
2016-12-19 21:17:49,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/home/hadoop/hbase-1.2.4/conf:/usr/java/jdk1.8.0_112/lib/tools.jar:/home/hadoop/hbase-1.2.4:/home/hadoop/hbase-1.2.4/lib/activation-1.1.jar:/home/hadoop/hbase-1.2.4/lib/aopalliance-1.0.jar:/home/hadoop/hbase-1.2.4/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hbase-1.2.4/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hbase-1.2.4/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hbase-1.2.4/lib/api-util-1.0.0-M20.jar:/home/hadoop/hbase-1.2.4/lib/asm-3.1.jar:/home/hadoop/hbase-1.2.4/lib/avro-1.7.4.jar:/home/hadoop/hbase-1.2.4/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase-1.2.4/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase-1.2.4/lib/commons-cli-1.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-codec-1.9.jar:/home/hadoop/hbase-1.2.4/lib/commons-collections-3.2.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-compress-1.4.1.jar:/home/hadoop/hbase-1.2.4/lib/commons-configuration-1.6.jar:/home/hadoop/hbase-1.2.4/lib/commons-daemon-1.0.13.jar:/home/hadoop/hbase-1.2.4/lib/commons-digester-1.8.jar:/home/hadoop/hbase-1.2.4/lib/commons-el-1.0.jar:/home/hadoop/hbase-1.2.4/lib/commons-httpclient-3.1.jar:/home/hadoop/hbase-1.2.4/lib/commons-io-2.4.jar:/home/hadoop/hbase-1.2.4/lib/commons-lang-2.6.jar:/home/hadoop/hbase-1.2.4/lib/commons-logging-1.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-math-2.2.jar:/home/hadoop/hbase-1.2.4/lib/commons-math3-3.1.1.jar:/home/hadoop/hbase-1.2.4/lib/commons-net-3.1.jar:/home/hadoop/hbase-1.2.4/lib/disruptor-3.3.0.jar:/home/hadoop/hbase-1.2.4/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/hbase-1.2.4/lib/guava-12.0.1.jar:/home/hadoop/hbase-1.2.4/lib/guice-3.0.jar:/home/hadoop/hbase-1.2.4/lib/guice-servlet-3.0.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-common-2.7.3-tests.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-hdfs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-hdfs-2.7.3-tests.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-hdfs-nfs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-app-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-core-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-hs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-jobclient-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-client-shuffle-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-mapreduce-examples-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-nfs-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-api-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-applications-distributedshell-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-client-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-registry-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-common-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-nodemanager-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-resourcemanager-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-tests-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hadoop-yarn-server-web-proxy-2.7.3.jar:/home/hadoop/hbase-1.2.4/lib/hbase-annotations-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-annotations-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-client-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-common-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-common-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-examples-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-external-blockcache-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-hadoop2-compat-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-hadoop-compat-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-it-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-it-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-prefix-tree-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-procedure-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-protocol-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-resource-bundle-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-rest-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-server-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-server-1.2.4-tests.jar:/home/hadoop/hbase-1.2.4/lib/hbase-shell-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/hbase-thrift-1.2.4.jar:/home/hadoop/hbase-1.2.4/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/hbase-1.2.4/lib/httpclient-4.2.5.jar:/home/hadoop/hbase-1.2.4/lib/httpcore-4.4.1.jar:/home/hadoop/hbase-1.2.4/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jackson-xc-1.9.13.jar:/home/hadoop/hbase-1.2.4/lib/jamon-runtime-2.4.1.jar:/home/hadoop/hbase-1.2.4/lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase-1.2.4/lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase-1.2.4/lib/javax.inject-1.jar:/home/hadoop/hbase-1.2.4/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hbase-1.2.4/lib/jaxb-api-2.2.2.jar:/home/hadoop/hbase-1.2.4/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase-1.2.4/lib/jcodings-1.0.8.jar:/home/hadoop/hbase-1.2.4/lib/jersey-client-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-core-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-guice-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-json-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jersey-server-1.9.jar:/home/hadoop/hbase-1.2.4/lib/jets3t-0.9.0.jar:/home/hadoop/hbase-1.2.4/lib/jettison-1.3.3.jar:/home/hadoop/hbase-1.2.4/lib/jetty-6.1.26.jar:/home/hadoop/hbase-1.2.4/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hbase-1.2.4/lib/jetty-util-6.1.26.jar:/home/hadoop/hbase-1.2.4/lib/joni-2.1.2.jar:/home/hadoop/hbase-1.2.4/lib/jruby-complete-1.6.8.jar:/home/hadoop/hbase-1.2.4/lib/jsch-0.1.42.jar:/home/hadoop/hbase-1.2.4/lib/jsp-2.1-6.1.14.jar:/home/hadoop/hbase-1.2.4/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/hbase-1.2.4/lib/junit-4.12.jar:/home/hadoop/hbase-1.2.4/lib/leveldbjni-all-1.8.jar:/home/hadoop/hbase-1.2.4/lib/libthrift-0.9.3.jar:/home/hadoop/hbase-1.2.4/lib/log4j-1.2.17.jar:/home/hadoop/hbase-1.2.4/lib/metrics-core-2.2.0.jar:/home/hadoop/hbase-1.2.4/lib/netty-all-4.0.23.Final.jar:/home/hadoop/hbase-1.2.4/lib/paranamer-2.3.jar:/home/hadoop/hbase-1.2.4/lib/protobuf-java-2.5.0.jar:/home/hadoop/hbase-1.2.4/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/hbase-1.2.4/lib/servlet-api-2.5.jar:/home/hadoop/hbase-1.2.4/lib/slf4j-api-1.7.7.jar:/home/hadoop/hbase-1.2.4/lib/slf4j-log4j12-1.7.5.jar:/home/hadoop/hbase-1.2.4/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hbase-1.2.4/lib/spymemcached-2.11.6.jar:/home/hadoop/hbase-1.2.4/lib/xmlenc-0.52.jar:/home/hadoop/hbase-1.2.4/lib/xz-1.0.jar:/home/hadoop/hbase-1.2.4/lib/zookeeper-3.4.9.jar:/home/hadoop/hadoop-2.7.3/etc/hadoop:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.7.3/share/hadoop/common/lib/para