發表於 程式分享

於ubuntu裝zookeeper (分布式協調服務)

1.下載zookeeper
https://www.apache.org/dyn/closer.lua/zookeeper/zookeeper-3.7.0/apache-zookeeper-3.7.0-bin.tar.gz

2.上傳至ubuntu的/usr/local/路徑下
3.解壓縮
cd /usr/local
tar xvf apache-zookeeper-3.7.0-bin.tar.gz
mv apache-zookeeper-3.7.0-bin zookeeper

4.建立路徑
/usr/local/hadoop/data/zookeeper/zkdata
/usr/local/hadoop/data/zookeeper/zkdatalog

新增檔案/usr/local/hadoop/data/zookeeper/zkdata/myid
內儲值1

5.新增/usr/local/zookeeper/conf/zoo.cfg

tickTime=2000
initLimit=10
syncLimit=5
dataDir=/usr/local/hadoop/data/zookeeper/zkdata
dataLogDir=/usr/local/hadoop/data/zookeeper/zkdatalog
clientPort=2181
server.1=ubuntu-VirtualBox:2888:3888

6.啟動zookeeper
/usr/local/zookeeper/bin/zkServer.sh start
/usr/local/zookeeper/bin/zkServer.sh status

jps
會有process

QuorumPeerMain

7.查看訊息
/usr/local/zookeeper/bin/zkCli.sh -server ubuntu-VirtualBox:2181

68.208.3:2181, session id = 0x100002e0cfa0000, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: ubuntu-VirtualBox:2181(CONNECTED) 0] ls /
[zookeeper]
[zk: ubuntu-VirtualBox:2181(CONNECTED) 0] ls /
[zookeeper]
[zk: ubuntu-VirtualBox:2181(CONNECTED) 1] create /test helloworld
Created /test
[zk: ubuntu-VirtualBox:2181(CONNECTED) 2] get /test
helloworld
[zk: ubuntu-VirtualBox:2181(CONNECTED) 3] get /test
helloworld
[zk: ubuntu-VirtualBox:2181(CONNECTED) 4] set /test zookeeper
[zk: ubuntu-VirtualBox:2181(CONNECTED) 5] get /test
zookeeper
[zk: ubuntu-VirtualBox:2181(CONNECTED) 6] delete /test
[zk: ubuntu-VirtualBox:2181(CONNECTED) 7]

7.啟動hadoop
start-all.sh
jps
有以下process

DataNode
NodeManager
SecondaryNameNode
ResourceManager
NameNode

8.啟動hbase
start-hbase.sh
jps
有以下process

HMaster
HRegionServer

9.查看HBase Web介面
http://ubuntu-virtualbox:16010/master-status

註: 啟動順序 zookeeper -> hadoop (hdfs) -> hbase

發表於 程式分享

於ubuntu安裝hBase

1.下載檔案
https://www.apache.org/dyn/closer.lua/hbase/2.3.6/hbase-2.3.6-bin.tar.gz

2.上傳至ubuntu的/usr/local/路徑下
3.解壓縮
cd /usr/local
tar xvf hbase-2.3.6-bin.tar.gz
mv hbase-2.3.6 hbase

4.配置環境變數
vi /etc/profile

export HBASE_HOME=/usr/local/hbase
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HBASE_HOME/bin

source /etc/profile

5.調整設定檔
cd /usr/local/hbase/conf
1) vi hbase-env.sh

export JAVA_HOME=/usr/local/jdk
export HBASE_MANAGES_ZK=true

2) vi hbase-site.xml

</configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://ubuntu-VirtualBox:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>ubuntu-VirtualBox</value>
</property>
</configuration>

6.啟動hbase
start-hbase.sh