Troubleshooting hdfs for hadoop optimization

This blog is mainly about troubleshooting hadoop hdfs, including NameNode fault handling, cluster security mode and disk repair. If there is something bad, welcome everyone! thank! nn Fault Handling 1. Scene The NameNode process hangs and the stored data is lost. How to recover the NameNode 2. Fault simulation (1) kill -9 NameNode proce ...

Added by Stressed on Sat, 18 Dec 2021 15:50:32 +0200

redis distributed cache entry to proficiency

01... Getting started with redis caching brief introduction background In our current project architecture, the Web server (Tomcat) and database are basically deployed independently and monopolize the server resources. With the growth of the number of users, concurrent reading and writing to the database will increase the pressure on dat ...

Added by ronald29x on Sat, 18 Dec 2021 14:44:29 +0200

MooseFS distributed network file system

catalogue 1, Foreword 1. Introduction to moosefs 2. Characteristics of moosefs (1) Tomographic structure (directory tree) (2) Store file properties (permissions, access, and modification time) (3) Support special files (block device, character device, pipeline) (4) Symbolic link (5) Access to the file system can be restricted by IP addr ...

Added by pablocullen on Sat, 18 Dec 2021 01:26:30 +0200

RabbitMQ practical tutorial (video learning notes)

RabbitMQ practical tutorial In this paper, I personally experiment and modify some places for the notes in the video recorded when learning rabbitmq. The versions of centos and rabbitmq used are different from those in the video. You can give the video three links to support up master ha. The video address is: https://www.bilibili.com/video ...

Added by Crysma on Thu, 16 Dec 2021 23:50:23 +0200

Java distributed locking schemes and differences

Implementation of distributed lock There are three common implementations of distributed locks: Redis implementationZookeeper implementationDatabase implementation 1. Redis based implementation There are three important commands in Redis. Distributed locking can be realized through these three commands setnx key val: if and only if the key ...

Added by flemingmike on Thu, 16 Dec 2021 03:56:55 +0200

Establishment and use of sentinel mode of redis high availability cluster

1, Briefly talk about the redis sentinel sentinel mode 1. Make the redis cluster more robust and highly available. Compared with redis cluster, it can automatically failover and automatically transform the master 2. Its workflow is that Sentinel will constantly check whether your master server and slave server are operating normally. If there ...

Added by jamesmage on Wed, 15 Dec 2021 16:57:54 +0200

Automatic creation mechanism of RocketMQ theme

problem When learning RocketMQ, I have several questions. If the subject does not exist, who will the client send the message to? When a message is sent to a topic that does not exist, when is the topic created? guess When I execute the following code, the topic does not exist, so when did I create the topic "TopicTest202112151152" ...

Added by AbsolutelyFreeW on Wed, 15 Dec 2021 15:41:23 +0200

Distributed transactions and Seata

Distributed transaction overview In the microservice architecture, different services have their own independent databases. In the past, the transaction control of a single application is based on the connection, that is, all operations are one transaction after each connection to the database. This is obviously not applicable in distributed m ...

Added by christophe on Tue, 14 Dec 2021 21:03:15 +0200

spring boot shiro+session+redis realizes login session, session retention and distributed session sharing

reference resources: Shiro Springboot cluster shared Session (Redis) + single user login https://zhuanlan.zhihu.com/p/54176956 Frame construction 1. Basic environment jdk8 maven lombok spring boot 2.5.7 2. Import shiro maven coordinates <dependency> <groupId>org.apache.shiro</groupId> <artifactId>shiro-sprin ...

Added by Getran on Sat, 11 Dec 2021 15:11:59 +0200

Principle and implementation of Redis distributed lock

When operating on the same resource, a single cache read is no problem, but what to do when concurrency exists. In order to avoid data inconsistency, we need to perform a "lock" operation before operating the shared resource. We are developing many business scenarios that use locks, such as inventory control, lucky draw, second kill, ...

Added by rdub on Sat, 11 Dec 2021 14:22:07 +0200