[CentOS] install HBase components
Preparation environment:
Hadoop fully distributed cluster environmentHBase installation package: https://archive.apache.org/dist/hbase/
1. Unzip HBase installation package
Upload local installation package:
Unzip and rename:
Back to top
2. System environment variable configuration
Configure the environment variables a ...
Added by ManOnScooter on Fri, 25 Feb 2022 12:06:45 +0200
Installation and configuration of Hbase
1, Task structure
2, Test purpose and requirements
1. Experimental purpose
1. Installation and verification of high availability fully distributed mode of HBase 2. Complete the installation of high availability full distribution mode of HBase 3. The related service processes of HBase can be started normally 4. HBase console can be used ...
Added by digibrain on Wed, 09 Feb 2022 14:29:03 +0200
Phoenix practice -- a summary of common basic syntax of Phoenix SQL
For detailed syntax, see Official website grammar Here are just some common grammars
Common command operations of Phoenix Shell
!table --View table information
!describe tablename --You can view table field information
!history --You can view the execution history SQL
!dbinfo
!index tb; --see tb Index of
!quit; --sign out phoenix shell
hel ...
Added by cgrenda on Wed, 02 Feb 2022 08:59:25 +0200
Importing Excel data into hbase
Table design
Column cluster: 1-2 are recommended. If you can use one, you can't use twoVersion design: if our project does not need to save historical VERSIONS, it is OK to directly configure VERSIONS=1 according to the default configuration. If you need to save historical change information in the project, you can set VERSIONS to > 1. Bu ...
Added by switchdoc on Sat, 29 Jan 2022 16:29:20 +0200
HBase RIT problem handling
Question:
Recently, it was found that 1W + region s in HBase clusters are in RIT state, resulting in many HBase clusters being unavailable.
HBase version:
2.0.1
Problem location:
1. At first, I thought it was just a simple timeout, so I manually modified the meta table status through the script (ing - > closed), then scrolled to restart ...
Added by lawnmowerman on Fri, 31 Dec 2021 09:58:11 +0200
2021SC@SDUSC Hbase project code analysis - HFile write to Cell
2021SC@SDUSC
1, Foreword
In this article, let's briefly introduce the main process of HFile writing to Cell
2, Analysis
One of the initiation locations where HFile file cells are written is the preformFlush() method of storeflush when Memstore flush:
/**
* Performs memstore flush, writing data from scanner into sink.
*
* @param ...
Added by killswitchfilter on Wed, 29 Dec 2021 13:23:28 +0200
hive learning ---- basic sentences
The previous chapter introduced how to install hive and the basic introduction of hive. Here we start using hive. Before using, first introduce the learning of the basic statements of hive, and what are internal tables and external tables.
hive base statement
Let's take a look at the most basic formats, because there are many kinds of fo ...
Added by FezEvils on Mon, 27 Dec 2021 07:35:09 +0200
impala, hive, phoenix, hbase mapping test
**Requirements: you want to maintain two wide tables on phoenix, one for ad hoc query, one for one day's data and one for history. The characteristic of wide table is that it is composed of multiple tables, but the arrival time of each table is inconsistent. Some tables arrive first, and some tables may arrive every other day. What you want to ...
Added by crashmaster on Sat, 25 Dec 2021 03:58:04 +0200
Hbase source code analysis MemStore flush processing 2021SC@SDUSC
preface
Following the problems mentioned above, this paper studies the flush processing flow of MemStore on HRegionServer, focusing on how to select an hregon to flush to alleviate the pressure of MemStore, and how hregon flush is initiated.
1, How to select an hregon to flush to relieve the pressure of MemStore
As mentioned above, i ...
Added by jay7981 on Wed, 08 Dec 2021 04:15:59 +0200
Experiment 3: familiar with common HBase operation
1, Experimental purpose
(1) Understand the role of HDFS in Hadoop architecture;
(2) Proficient in using HDFS to operate common Shell commands;
(3) Familiar with Java API s commonly used in HDFS operation.
2, Experimental platform
Operating system: Linux (CentOS recommended);Hadoop version: 3.2.2;HBase version: 2.3.6;JDK version: 1.7 or abo ...
Added by pido on Sat, 16 Oct 2021 10:08:47 +0300