HBase Setup: Standalone Mode on windows machine

-
HBase is a popular NoSQL kind of database over HDFS. It is a column-oriented database based on the Google's BigTable. It can be setup in 3-modes:
  • Standalone Mode (without HDFS)
  • Pseudo-Distributed mode (With single node HDFS)
  • Fully-distributed mode
Out of the 3, for now it can be setup on windows only in standalone mode. But this mode is enough to play around and get familiar with it. It is quite easy to set-up but there are a few caveats that come in handy while troubleshooting especially if you are new to HBase. I'll mention them as I go in red. So,let's get started with the basic setup:
  1. First step is to download the stable version(found in the folder named "stable" at the mirror loction) of HBase as a tarball from the website and unzip into a suitable location.  From the suggested mirror site, look for the hbase--bin.tar.gz




  2. Next thing to ensure is that Java is installed on your system and JAVA_HOME is set. To verify that open command prompt (cmd) and type "java version" and it should show you the version of java installed. You also have the option of mentioning the path directly in the hbase-env.bat that resides in the /conf.
    3. Tip: Beware of spaces in the Java path. HBase has problems identifying such path. If your Java resides in "C:/Program Files", use the shorthand "C:/Progra~1" instead.


  3. The other things to change in the hbase-env.bat are:
    • HBASE_IDENT_STRING (It may already be there, just needs to be uncommented)
     set HBASE_IDENT_STRING=%USERNAME%

  4. Now we need to modify the hbase-site.xml which is the main configuration file for hbase. It needs following properties for a standalone instance:
    • hbase.root.dir: 
    • hbase.tmp.dir: This is where HBase creates its local datastore and some other folders concerning the zookeeper.
    • hbase.zookeeper.quorum: Zookeeper instance. In this case, it will be 127.0.0.1 (I'm using the ip instead of "localhost" as HBase sometimes has trouble identifying the ip from domain name).
     
      <property>  
           <name>hbase.root.dir</name>  
           <value>D:\tmp\hbase\data</value>  
      </property>  
      <property>  
           <name>hbase.tmp.dir</name>  
           <value>D:\tmp\hbase\tmp</value>  
      </property>  
      <property>  
           <name>hbase.zookeeper.quorum</name>  
           <value>127.0.0.1</value>  
      </property>

  5. Set uo HBASE_HOME as the environment variable and include the %HBASE_BIN%\bin to the Path env variable.
  6. Open a command prompt and go to the bin folder in HBase installation location. Run the file "start-hbase.cmd" to start HBase.
  7. Tip/Caveat: If you do not have a Hadoop installation on your machine Hbase startup may fail saying that it cannot find the "winutil" library. This is because HBase looks for windows native lib winutils and hadoop.dll in the path mentioned against "HADOOP_HOME" env variable. So keep these two files in any directory and export that path as HADOOP_HOME either as env variable or in the hbase-env.bat.
Once started in a command prompt, navigate to the bin folder in Hbase installation and run command "hbase shell" to start the hbase shell. You can then run some hbase shell commands to verify your installation (More on the commands in next post!)


Enjoy playing around with HBASE!




Comments

Post a Comment

Popular posts from this blog

Plotting Choropleths with Shapefiles in R- ggplot2 tutorial

-
Image
We all love some nice colored maps which can convey certain characteristics of the data. There are a lot of different libraries that provide in-built maps which can be rendered with one-liners. This post attempts to create maps or choropleths out of maps which can be created using the shapefiles available over the internet. The advantage clearly is that we can build any kind of map be it a country, state or region within a district or city. The dataset I'm experimenting with here is available at Kaggle . It is a dataset about the demographics of 500 top cities of India. It publishes details like Adult and child populations, Sex ratio, Literacy figures, and Graduate population figures in each of these cities. Through the course of this post, I'll explore the various functions and libraries of R that have been integrated together while telling some interesting facts about the dataset and Yes! all through the choropleths. What are choropleths and shapefiles anyway? Accord...
Read more

Self-Organizing Maps: An interesting Neural Network

-
Image
Introduction Kohonen Map or Self Organizing Maps are based on how our brain cells are organized to form topologically ordered maps that react to different sensory input signals by activating different regions of cerebral cortex. On similar lines, SOM also builds a lattice of neurons with similar neurons being closer to each other and uses this lattice to cluster the data together in lower dimensional space. It is an artificial neural network algorithm developed by Teuvo Kohonen to be applied in the field of unsupervised learning. It is based on the principle of competitive learning where the neurons compete with each other for every input sample with winning neuron making its output as one while rest all make it zero.  The process of learning happens in two phases: Ordering Phase where the neurons order themselves topologically and Convergence Phase where the final update of weights happens to move them further closer to the input space. SOM provides an effective and ea...
Read more