hadoop_ Hdfs07 hdfsha cluster configuration & ZK cluster configuration & yarnHA configuration

hadoop_ Hdfs07 hdfsha cluster configuration & ZK cluster configuration & yarnha configuration Note: notes (1) Cluster planning Hadoop102Hadoop03Hadoop04ZKZKZKJournaleNodeJournaleNodeJournaleNodeNameNodeNameNodeDataNodeDataNodeDataNodeResourceManagerResourceManagerNodeManagerNodeManagerNodeManager (2) Configuring Zookeeper clusters ...

Added by DarkArchon on Sun, 26 Dec 2021 06:36:22 +0200

Raft algorithm_ SOFAJRaft source code learning_ (I. background and main selection demonstration)

background For the principle of raft algorithm, it is recommended to refer to the raft official website: https://raft.github.io/ It is highly recommended to watch the process animation of raft to facilitate intuitive understanding of the algorithm process Animation address: http://thesecretlivesofdata.com/raft/ By reading the source code ...

Added by renegade888 on Sat, 25 Dec 2021 01:12:42 +0200

ZooKeeper source code analysis of the complete network communication process

2021SC@SDUSC preface In the previous chapter, the server handles the request and writes it to the buffer of the client through the sendBuffer() method of NIOServerCnxn. In the previous step, the ConnectResponse response object has been initialized, so RSP will be called after writing Serialize (Bos, "connect") returns a ConnectR ...

Added by dumbass on Tue, 21 Dec 2021 14:57:21 +0200

My Distributed ID Service

Distributed ID Project Main functions: Distributed Project Acquisition ID UniqueImplement high availability and dynamic scalingHow to squeeze server resources 1. How to Keep ID Unique Determining that the primary key ID is obtained is the only global need to ensure that the ID contains these elements: Timestamp, globally unique and self-in ...

Added by peaforabrain on Tue, 21 Dec 2021 07:36:14 +0200

Introduction to SpringBoot: asynchronous, mail tasks, scheduled tasks, distributed RPC overview, Dubbo and Zookeeper

Asynchronous task Asynchronous overview Asynchrony is to start the next request immediately after sending a request, regardless of whether the return value is received or not, or whether the return value is received after a long time. Compared with the system, it has great advantages because it makes great use of resources. It is opposite to ...

Added by tzicha on Mon, 20 Dec 2021 00:14:36 +0200

[SpringBoot] distributed (Dubbo + Zookpeer) - service registration and discovery

1, What is distributed Distributed computing is a new computing method proposed in recent years. The so-called distributed computing is that two or more software share information with each other. These software can run on the same computer or multiple computers connected through the network. In distributed system principles and mode ...

Added by GregArtemides on Sun, 19 Dec 2021 22:34:26 +0200

Dubbo Note Sorting

Dubbo 1. Overview of Apache Dubbo 1.1 Introduction Apache Dubbo is a high performance RPC framework, formerly Alibaba Open Source, a lightweight open source RPC framework that seamlessly integrates with the Spring framework, which Alibaba donated to the Apache Foundation in 2018 What is RPC? RPC is called remote procedure call, which i ...

Added by acallahan on Sat, 18 Dec 2021 07:10:12 +0200

ZooKeeper source code analysis of the complete network communication process

2021SC@SDUSC preface Next, we will enter the source code world to analyze step by step how the client and server establish network communication through ClientCnxn/ServerCnxn. This time, the content will be divided into three chapters. In this chapter, we will introduce how the client sends the request to the server. The latter two chapte ...

Added by siko on Mon, 06 Dec 2021 04:20:25 +0200

Introduction to big data

1, Introduction to big data 1. Data and data analysis 2. Role of data analysis Current situation analysisCause analysisForecast analysis 3. Basic steps of data analysis Clarify the purpose of analysisdata collectiondata processingData analysisData presentationReport writing 4. Big data What is big dataThe challenge of massive dataCharac ...

Added by Monkeymatt on Sun, 21 Nov 2021 09:40:44 +0200

Research on storm source code analysis

2021SC@SDUSC bolt source code analysis (III) 2021SC@SDUSC This article mainly introduces the bolt interface Bolt interfaces defined in Storm mainly include IBolt, IRichBolt, IBasicBolt and IBatchBolt The relationships are as follows: IBolt.java IBolt defines the function set of Bolt, and its code is as follows: public interface IBolt ex ...

Added by ducey on Thu, 18 Nov 2021 16:21:01 +0200