Troubleshooting hdfs for hadoop optimization
This blog is mainly about troubleshooting hadoop hdfs, including NameNode fault handling, cluster security mode and disk repair. If there is something bad, welcome everyone! thank!
nn Fault Handling
1. Scene The NameNode process hangs and the stored data is lost. How to recover the NameNode 2. Fault simulation (1) kill -9 NameNode proce ...
Added by Stressed on Sat, 18 Dec 2021 15:50:32 +0200
redis distributed cache entry to proficiency
01... Getting started with redis caching
brief introduction
background
In our current project architecture, the Web server (Tomcat) and database are basically deployed independently and monopolize the server resources. With the growth of the number of users, concurrent reading and writing to the database will increase the pressure on dat ...
Added by ronald29x on Sat, 18 Dec 2021 14:44:29 +0200
MooseFS distributed network file system
catalogue
1, Foreword
1. Introduction to moosefs
2. Characteristics of moosefs
(1) Tomographic structure (directory tree)
(2) Store file properties (permissions, access, and modification time)
(3) Support special files (block device, character device, pipeline)
(4) Symbolic link
(5) Access to the file system can be restricted by IP addr ...
Added by pablocullen on Sat, 18 Dec 2021 01:26:30 +0200
RabbitMQ practical tutorial (video learning notes)
RabbitMQ practical tutorial
In this paper, I personally experiment and modify some places for the notes in the video recorded when learning rabbitmq. The versions of centos and rabbitmq used are different from those in the video. You can give the video three links to support up master ha. The video address is: https://www.bilibili.com/video ...
Added by Crysma on Thu, 16 Dec 2021 23:50:23 +0200
Java distributed locking schemes and differences
Implementation of distributed lock
There are three common implementations of distributed locks:
Redis implementationZookeeper implementationDatabase implementation
1. Redis based implementation
There are three important commands in Redis. Distributed locking can be realized through these three commands
setnx key val: if and only if the key ...
Added by flemingmike on Thu, 16 Dec 2021 03:56:55 +0200
Establishment and use of sentinel mode of redis high availability cluster
1, Briefly talk about the redis sentinel sentinel mode
1. Make the redis cluster more robust and highly available. Compared with redis cluster, it can automatically failover and automatically transform the master 2. Its workflow is that Sentinel will constantly check whether your master server and slave server are operating normally. If there ...
Added by jamesmage on Wed, 15 Dec 2021 16:57:54 +0200
Automatic creation mechanism of RocketMQ theme
problem
When learning RocketMQ, I have several questions. If the subject does not exist, who will the client send the message to? When a message is sent to a topic that does not exist, when is the topic created?
guess
When I execute the following code, the topic does not exist, so when did I create the topic "TopicTest202112151152" ...
Added by AbsolutelyFreeW on Wed, 15 Dec 2021 15:41:23 +0200
Distributed transactions and Seata
Distributed transaction overview
In the microservice architecture, different services have their own independent databases. In the past, the transaction control of a single application is based on the connection, that is, all operations are one transaction after each connection to the database. This is obviously not applicable in distributed m ...
Added by christophe on Tue, 14 Dec 2021 21:03:15 +0200
spring boot shiro+session+redis realizes login session, session retention and distributed session sharing
reference resources: Shiro Springboot cluster shared Session (Redis) + single user login
https://zhuanlan.zhihu.com/p/54176956
Frame construction
1. Basic environment
jdk8 maven lombok spring boot 2.5.7
2. Import shiro maven coordinates
<dependency>
<groupId>org.apache.shiro</groupId>
<artifactId>shiro-sprin ...
Added by Getran on Sat, 11 Dec 2021 15:11:59 +0200
Principle and implementation of Redis distributed lock
When operating on the same resource, a single cache read is no problem, but what to do when concurrency exists. In order to avoid data inconsistency, we need to perform a "lock" operation before operating the shared resource.
We are developing many business scenarios that use locks, such as inventory control, lucky draw, second kill, ...
Added by rdub on Sat, 11 Dec 2021 14:22:07 +0200