Versions Compared

Old Version 13

changes.mady.by.user Albert Shau

Saved on

compared with

New Version 14

changes.mady.by.user Sagar Kapare

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Install the relevant cdap-hbase-compat package on all hbase nodes in your cluster in order to use the replication status coprocessors. Note that due to HBase limitations, these coprocessors cannot be used on hbase 0.96 or 0.98. Compat packages are:

    1. cdap-hbase-compat-1.0
    2. cdap-hbase-compat-1.0-cdh
    3. cdap-hbase-compat-1.0-cdh5.5.0
    4. cdap-hbase-compat-1.1
    5. cdap-hbase-compat-1.2-cdh5.7.0

  • Modify hbase-site.xml on all hbase nodes to enable hbase replication, and to use the CDAP replication status coprocessors

    Code Block
    <property>
  <name>hbase.replication</name>
  <value>true</value>
</property>
<property>
  <name>hbase.coprocessor.regionserver.classes</name>
  <value>co.cask.cdap.data2.replication.LastReplicateTimeObserver</value>
</property>
<property>
  <name>hbase.coprocessor.wal.classes</name>
  <value>co.cask.cdap.data2.replication.LastWriteTimeObserver</value>
</property>

  • Modify hbase-env.sh on all hbase nodes to include the hbase coprocessor in the classpath 

    Code Block
    export HBASE_CLASSPATH="$HBASE_CLASSPATH:/opt/cdap/<hbase-compat-version>/coprocessor/*"
 
for example, if you're on cdh5.5.x and have installed the cdap-hbase-compat-1.0-cdh5.5.0 package:
export HBASE_CLASSPATH="$HBASE_CLASSPATH:/opt/cdap/hbase-compat-1.0-cdh5.5.0/coprocessor/*"
  • Restart hbase master and regionservers

  • Enable replication from master to slave 

    Code Block
    master hbase shell> add_peer, '[slave-name]', '[slave-zookeeper-quorum]:/[slave-zk-node]'
 
example:
master hbase shell> add_peer, 'hbase2', 'hbase2-master.domain.net:2181:/hbase'

  • Enable replication from slave to master 

    Code Block
    slave hbase shell> add_peer, '[master-name]', '[master-zookeeper-quorum]:/[master-zk-node]'
 
example:
slave hbase shell> add_peer, 'hbase1', 'hbase1-master.domain.net:2181:/hbase'

  • Check replication is working 

    Code Block
    master hbase shell> create 'repltest', 'f'
slave hbase shell> create 'repltest', 'f'
master hbase shell> enable_table_replication 'repltest'
slave hbase shell> alter 'repltest', { 'NAME' => 'f', 'REPLICATION_SCOPE' => 1 }
master hbase shell> put 'repltest', 'masterrow', 'f:v1', 'v1'
slave hbase shell> put 'repltest', 'slaverow', 'f:v1', 'v1'
master hbase shell> scan 'repltest'
slave hbase shell> scan 'repltest'

...