Programming VIP

1, Canal introduction In the early days, Alibaba had the business requirement of cross machine room synchronization due to the deployment of dual machine rooms in Hangzhou and the United States. The implementation method was mainly to obtain incremental changes based on the business trigger. Since 2010, the business has gradually tried to obta ...

Tags (space delimited): building large data platforms 1. Download and install Phoenix parcel 2. Install CSD files 3. Add Phoenix service in Cloudera Manager (provided HBase service is installed) 4. Configure HBase for Phoenix V. Verify Phoenix installation and smoke test 6. Import Data Validation Test 7. Integration of phoinex schema with ...

phenomenon There are two clusters A and B on the line, which are configured with two-way synchronization and single activity, i.e. only one cluster will be visited at a certain time by the business layer.A lot of exceptions have been reported in the regionserver log of Cluster A recently, but the monitoring page is working and functionality is ...

Data backup of HBase 1.1 backup the table based on the class provided by HBase Use the class provided by HBase to export the data of a table in HBase to HDFS, and then to the test HBase table. (1) = = export from hbase table to HDFS== [hadoop@node01 shells]$ hbase org.apache.hadoop.hbase.mapreduce.Export myuser /hbase_data/myuser_bak (2 ...

For version 2.1.6, the use of coprocessor requires the introduction of HBase common dependency. Next, record the detailed steps of debugging the test coprocessor   Case background There are two tables, user and people. Each table has a person column family. Now, before inserting "people:name ...

Problem description issue A: after turning on the parameter (phoenix.stats.enabled=true), use Phoenix SQL to query the data, and there are duplicates (the data found is more than the actual content stored in HBase) issue B: after the parameter is closed (phoenix.stats.enabled=false), Phoenix SQL performance decreases. Environmental Science Phoe ...

I. Phoenix overview 1, introductionPhoenix can be understood as the query engine of HBase, Phoenix, a project open-source by saleforce.com, and then donated to Apache. It is equivalent to a Java middleware to help developers, such as using jdbc to access relational databases, and accessing NoSql database HBase. phoenix, the table and data of o ...

In the process of time maneuvering, judging by adding time stamp to the program, when inquiring HBase in batches, there will be some data inquiry time more than 8s, which is definitely unacceptable. Looking at hbase's logs, we can find the reasons. There are similar logs'GC pool'. It is speculated th ...

zookeeper installation 1. Upload installation package to / opt directory 2. Decompression: tar -zxf /opt/zookeeper-3.4.14.tar.gz -C ./ 3. Configure environment variables: vim /etc/profile export ZK_HOME=/opt/zookeeper-3.4.14 export PATH=$Z ...

Explanation: I don't know why the editor suddenly got stuck. It can only be divided into two pieces 4. Install pinpoint-web 4.1 Deploy the war package Unzip Tomcat and move the Tomcat rename to the specified location cd /home/pp_res/ tar -zxvf apache-tomcat-8.0.36.tar.gz mv apache-tomcat-8.0.36/ /data/service/pp-web Modify the configura ...