RabbitMQ [Message Queue]
Message Queue Introduction
A message is the data being transmitted Message Queue is a form of communication that can be returned immediately after sending a message There is a messaging system to ensure reliable delivery of messages Message publishers can only publish messages to MQ without having to care about others Message consumers ...
Added by jp2php on Mon, 10 Jan 2022 19:11:45 +0200
13, kafka consumer findCoordinator
Here, let's sort out the relevant knowledge of consumeGroup
1. First, we will set groupId for each consumer. Consumers with the same groupId and subscribed to the same topic will form a consumeGroup, as shown in Figure 1
2. For the topic on the Server side, there is the concept of partition, as shown in Figure 2
3. Now we have multiple con ...
Added by mitch.craig on Mon, 10 Jan 2022 02:36:52 +0200
Basics: introduction to distributed locks
catalogue
Fundamentals: distributed locks
Why do I need distributed locks?
Characteristics of distributed locks
Common scenarios
Redis implements distributed locks
Redisson distributed lock entry practice
reference
Fundamentals: distributed locks
The synchronized keyword and ReentrantLock reentrant lock in Java can control concurrent ...
Added by lauxanh on Sun, 09 Jan 2022 06:10:50 +0200
Zookeeper cluster and listener principle
1, Zookeeper cluster operation
Objective: deploy Zookeeper on Hadoop 101, Hadoop 102 and Hadoop 103 nodes.
1.1 decompression and installation
In Hadoop 101, unzip the Zookeeper installation package to the / usr/local / directory
decompression
[root@hadoop101 local]# tar -zxvf apache-zookeeper-3.6.3-bin.tar.gz
Delete compressed package
[roo ...
Added by dwu on Sat, 08 Jan 2022 13:23:42 +0200
Netty communication technology
1, Introduction
1, Overview
Netty is an open source framework provided by JBOSS. In essence, it is a network application framework. It provides a non blocking and event driven network application framework and tools to facilitate the rapid development of high-performance and reliable network server and client.
2, Core architecture
...
Added by RobertSubnet on Thu, 06 Jan 2022 12:02:11 +0200
Reission use case
redission
1,pom.xml
<dependency>
<groupId>org.redisson</groupId>
<artifactId>redisson</artifactId>
<version>version</version>
</dependency>
2,redissionUtils
public class RedissionUtils {
private static Logger logger = LoggerFactory.getLogger(RedissionUtils.class);
private static ...
Added by Jene200 on Wed, 05 Jan 2022 17:51:28 +0200
Idempotency of distributed interface and distributed current limiting (Guava, nginx and lua current limiting)
1, Interface idempotency
Interface idempotency means that the results of one request or multiple requests initiated by the user for the same operation are consistent, and there will be no side effects due to multiple clicks. The simplest example is payment. The user pays after purchasing goods, and the payment is deducted successfully. However ...
Added by idgeit on Wed, 05 Jan 2022 11:20:16 +0200
Analysis of duplicate order number caused by improper use of online redis distributed lock
background
The day before yesterday, my colleague reported that there was a problem with the redis distributed lock, resulting in duplicate order numbers. Later, everything was normal after it was replaced with reission. Based on this phenomenon, this paper analyzes it
Problem driven
The following code is analyzed and three problems are foun ...
Added by bluetonic on Tue, 04 Jan 2022 19:27:01 +0200
Solution to realize distributed lock
1. Distributed lock
1.1 what is distributed lock
When we develop a stand-alone application involving concurrent synchronization, we often use synchronized or ReentrantLock to solve the problem of code synchronization between multiple threads. However, when our application works in a distributed cluster, we need a more advanced locking m ...
Added by shmeeg on Tue, 04 Jan 2022 18:45:44 +0200
Log information and configuration information of the Scrapy framework
1. Log information of the sweep
2. Common configuration of scratch
ROBOTSTXT_ Whether obey complies with the robots protocol. The default is compliance
About robots protocol
In Baidu search, you can't search the details page of a specific commodity on Taobao. This is the robots protocol at workRobots protocol: the website tells se ...
Added by dubt2nv on Tue, 04 Jan 2022 04:08:23 +0200