Research on storm source code analysis
2021SC@SDUSC
bolt source code analysis (III)
2021SC@SDUSC
This article mainly introduces the bolt interface
Bolt interfaces defined in Storm mainly include IBolt, IRichBolt, IBasicBolt and IBatchBolt The relationships are as follows:
IBolt.java
IBolt defines the function set of Bolt, and its code is as follows:
public interface IBolt ex ...
Added by ducey on Thu, 18 Nov 2021 16:21:01 +0200
Hadoop practice chapter - cluster version
Hadoop practice (2)Author WenasWeiprefaceIn the previous Hadoop practical chapter, I introduced the local mode and pseudo cluster mode installation of Hadoop offline batch processing technology. Next, I will continue to learn the Hadoop cluster mode installation; It will be introduced from the following points:Linux host deployment planningZook ...
Added by zleviticus on Thu, 18 Nov 2021 11:39:42 +0200
[Python] 2D scatter diagram, 3D scatter diagram, scatter diagram matrix
catalogue
1. Two main features: 2D scatter diagram
1.1 two dimensional scatter diagram
1.2 two dimensional classified scatter diagram
1.3 bubble chart
2. Three main features: three-dimensional scatter diagram
2.1 three dimensional scatter diagram
2.2 three dimensional classified scatter diagram
3. Multi principal features: 2D scatter ma ...
Added by thegame261 on Wed, 17 Nov 2021 14:14:34 +0200
Synchronize mysql data to doris in real time, Mysql+kafka+flink+doris
1. Use background
Recently, the group wants to build a set of real-time data warehouse in the existing environment. After comprehensive analysis, doris will be used as the database of real-time data warehouse. The data sources include message data and business database data.
2. Data source access
It's easy to say the message data. Whether pu ...
Added by Knutty on Wed, 17 Nov 2021 08:58:01 +0200
Elasticsearch installation, configuration and use
The reason why Es is a member of the elastic stack family is that its search function is very powerful. In fact, it is a distributed search engine.
install
The installation of this article is based on Ubuntu 20.04 TLS virtual machine and adopts the mode of. tar.gz, < Click to download Linux x86_64 bit tar. GZ >
After extracting the dow ...
Added by xAtlas on Thu, 11 Nov 2021 06:31:37 +0200
Consumer client development
Consumer client development
After understanding the concept of consumer and consumer group, we can start the development of consumer client. In the history of Kafka, the consumer client, like the producer client, has experienced two major versions: the first is a client written in scala at the beginning of Kafka's ...
Added by sebmaurer on Thu, 11 Nov 2021 02:20:20 +0200
Hadoop -- MapReduce implements word statistics (Graphic super detailed version)
1, Previously on
The last article introduced the Api calling method of MapReduce and the configuration of eclipse. This time, we will use MapReduce to count words in English article files!
Welcome to my previous article: MapReduce related eclipse configuration and Api call
2, Preconditions
Installation requiredDownload methodIDEAO ...
Added by webdes03 on Wed, 10 Nov 2021 21:15:32 +0200
How to use JMX_ Exporter + Prometheus + grafana monitor Hadoop cluster
JMX_Expotermonitor
At present, CDH and HDP will merge closed source in the future. The company plans to spend time developing a similar platform. I have also made some efforts in cluster monitoring.
monitor
For a cluster management platform, the first thing to bear the brunt is how to realize the monitoring. After all, many times we open ...
Added by n9ne on Mon, 08 Nov 2021 11:04:18 +0200
Distributed e-commerce project grain mall learning notes < 3 >
10, ES
7. Advanced - aggregation
Aggregation provides the ability to group and extract data from data.
The simplest aggregation method is roughly equal to SQL Group by and SQL aggregation function (average, maximum and minimum)
polymerization
It is used to process the queried data
# Including mil, average age
GET bank/_search
{
"que ...
Added by banjax on Sun, 07 Nov 2021 04:16:25 +0200
Hive of big data foundation -- partition table and bucket table
Author: duktig
Blog: https://duktig.cn (first article)
Excellent still work hard. May you enjoy what you give and enjoy what you get.
See github knowledge base for more articles: https://github.com/duktig666/knowledge
background
After learning Hadoop, do you feel that writing a MapReduce program is very complex, and it requires a lot ...
Added by mridang_agarwal on Tue, 02 Nov 2021 05:48:10 +0200