Programming VIP

Kafka cluster is composed of several brokers. Starting Kafka cluster is to start the brokers in the cluster and run normally. There are various interactions between brokers, between brokers and generators, and between brokers and consumers. The following is a brief introduction to the broker startup process. Script to start the broker: nohu ...

1. Set up zookeeper cluster 1.1 problems This case requires: Set up zookeeper cluster1 leader2 follower s1 observer 1.2 steps To implement this case, you need to follow the following steps. Step 1: install Zookeeper 1) Edit / etc/hosts and all cluster hosts can ping each other (configured on Hadoop 1 and synchronized to node-0001, ...

Topic Events are organized and persistently stored in Topic, which is similar to a folder in the file system, and events are the files in the folder. Topics in Kafka are always multi producers and multi subscribers: a Topic can have zero, one or more producers write events to it, or zero, one or more consumers subscribe to these events. The ev ...

This article strictly refers to the connection (strictly copying other people's content to prevent loss and facilitate your own viewing): https://www.cnblogs.com/xiao-xue-di/p/11840339.html#_label7 Reading catalog 1.1. major function 1.2. Usage scenarioConsumption group and partition rebalancing1.3. Detailed introduction2.1. download2.2. ...

rocketMq learning and Practice (I) Installation configuration download Binary download address: http://rocketmq.apache.org/release_notes/release-notes-4.8.0/ Docker pull address: docker pull foxiswho / rocketmq: server-4.3 two install Configure environment variables Find the installation package, start nameserver, enter the bin di ...

Flink reads Kafka data and sinks to Clickhouse In real-time streaming data processing, we can usually do real-time OLAP processing in the way of Flink+Clickhouse. The advantages of the two will not be repeated. This paper uses a case to briefly introduce the overall process. Overall process: Import json format data to kafka specific topicsWr ...

Introduction to Alibaba canal and its deployment, principle and use Introduction to canal What is canal Alibaba B2B company, because of the characteristics of its business, sellers are mainly concentrated in China and buyers are mainly concentrated in foreign countries, so it has derived the demand for remote computer rooms in Hangzhou and t ...

preface I want to try how to run the sql of flink. Last year, I saw that the big brother JarkWu shared it, but I haven't actually operated it. Recently, I'm interested. Original Jarkwu sharing Demo: building streaming applications based on Flink SQL. JarkWu github flink-sql-demo The boss is based on flink1 Version 10 is built, but the rel ...

This article is transferred from: Le byteThe article mainly explains: KafkaFor more Java related information, you can pay attention to the official account number: 999Asynchronous communication principleObserver modeObserver mode, also known as Publish/Subscribe modeDefine a one to many dependency between objects, so that whenever an object cha ...

How to select the appropriate number of partitions         How to select the appropriate number of partitions? This is a problem that many Kafka users often face, but there seems to be no very authoritative answer to this problem. Moreover, there is obviously no fixed answer to this question. We can only make specific analy ...