Research on storm source code analysis

2021SC@SDUSC bolt source code analysis (III) 2021SC@SDUSC This article mainly introduces the bolt interface Bolt interfaces defined in Storm mainly include IBolt, IRichBolt, IBasicBolt and IBatchBolt The relationships are as follows: IBolt.java IBolt defines the function set of Bolt, and its code is as follows: public interface IBolt ex ...

Added by ducey on Thu, 18 Nov 2021 16:21:01 +0200

Hadoop practice chapter - cluster version

Hadoop practice (2)Author WenasWeiprefaceIn the previous Hadoop practical chapter, I introduced the local mode and pseudo cluster mode installation of Hadoop offline batch processing technology. Next, I will continue to learn the Hadoop cluster mode installation; It will be introduced from the following points:Linux host deployment planningZook ...

Added by zleviticus on Thu, 18 Nov 2021 11:39:42 +0200

[Python] 2D scatter diagram, 3D scatter diagram, scatter diagram matrix

catalogue 1. Two main features: 2D scatter diagram 1.1 two dimensional scatter diagram 1.2 two dimensional classified scatter diagram 1.3 bubble chart 2. Three main features: three-dimensional scatter diagram 2.1 three dimensional scatter diagram 2.2 three dimensional classified scatter diagram 3. Multi principal features: 2D scatter ma ...

Added by thegame261 on Wed, 17 Nov 2021 14:14:34 +0200

Synchronize mysql data to doris in real time, Mysql+kafka+flink+doris

1. Use background Recently, the group wants to build a set of real-time data warehouse in the existing environment. After comprehensive analysis, doris will be used as the database of real-time data warehouse. The data sources include message data and business database data. 2. Data source access It's easy to say the message data. Whether pu ...

Added by Knutty on Wed, 17 Nov 2021 08:58:01 +0200

Elasticsearch installation, configuration and use

The reason why Es is a member of the elastic stack family is that its search function is very powerful. In fact, it is a distributed search engine. install The installation of this article is based on Ubuntu 20.04 TLS virtual machine and adopts the mode of. tar.gz, < Click to download Linux x86_64 bit tar. GZ > After extracting the dow ...

Added by xAtlas on Thu, 11 Nov 2021 06:31:37 +0200

Consumer client development

Consumer client development         After understanding the concept of consumer and consumer group, we can start the development of consumer client. In the history of Kafka, the consumer client, like the producer client, has experienced two major versions: the first is a client written in scala at the beginning of Kafka's ...

Added by sebmaurer on Thu, 11 Nov 2021 02:20:20 +0200

Hadoop -- MapReduce implements word statistics (Graphic super detailed version)

1, Previously on The last article introduced the Api calling method of MapReduce and the configuration of eclipse. This time, we will use MapReduce to count words in English article files! Welcome to my previous article: MapReduce related eclipse configuration and Api call 2, Preconditions Installation requiredDownload methodIDEAO ...

Added by webdes03 on Wed, 10 Nov 2021 21:15:32 +0200

How to use JMX_ Exporter + Prometheus + grafana monitor Hadoop cluster

JMX_Expotermonitor At present, CDH and HDP will merge closed source in the future. The company plans to spend time developing a similar platform. I have also made some efforts in cluster monitoring. monitor For a cluster management platform, the first thing to bear the brunt is how to realize the monitoring. After all, many times we open ...

Added by n9ne on Mon, 08 Nov 2021 11:04:18 +0200

Distributed e-commerce project grain mall learning notes < 3 >

10, ES 7. Advanced - aggregation Aggregation provides the ability to group and extract data from data. The simplest aggregation method is roughly equal to SQL Group by and SQL aggregation function (average, maximum and minimum) polymerization It is used to process the queried data # Including mil, average age GET bank/_search { "que ...

Added by banjax on Sun, 07 Nov 2021 04:16:25 +0200

Hive of big data foundation -- partition table and bucket table

Author: duktig Blog: https://duktig.cn (first article) Excellent still work hard. May you enjoy what you give and enjoy what you get. See github knowledge base for more articles: https://github.com/duktig666/knowledge background After learning Hadoop, do you feel that writing a MapReduce program is very complex, and it requires a lot ...

Added by mridang_agarwal on Tue, 02 Nov 2021 05:48:10 +0200