1, Channel Selectors
Next, take a look at Channel Selectors Channel Selectors include: Replicating Channel Selector and Multiplexing Channel Selector The Replicating Channel Selector is the default Channel selector. It will send the events collected by the Source to all channels Check the official documentation for an explanation of this defau ...
Added by deed02392 on Fri, 04 Mar 2022 21:08:31 +0200
1, Source Interceptors
Next, let's take a look at the first advanced component, Source Interceptors
Many Source Interceptors have been built into the system Common types of Source Interceptors: Timestamp Interceptor, Host Interceptor, Search and Replace Interceptor, Static Interceptor, Regex Extractor Interceptor, etc
1,Timestamp Interceptor ...
Added by bdamod1 on Fri, 04 Mar 2022 07:35:30 +0200
Flume is a highly available, reliable and distributed system for massive log collection, aggregation and transmission provided by Cloudera. Flume is based on streaming architecture, which is flexible and simple.
① It can be integrated with any storage process
② When th ...
Added by jcstanley on Wed, 19 Jan 2022 16:03:41 +0200
Flume is a highly available, reliable and distributed software for massive log collection, aggregation and transmission provided by Cloudera.
The core of flume is to collect data from the data source, and then send the collected data to the specified destination (sink). In order to ensure the success of the transp ...
Added by manamino on Tue, 11 Jan 2022 13:39:36 +0200
Flume log collection
1, Flume introduction
Logo refers to the transfer of wood (data) from one place (data source) to another place (data destination) through the river channel (channel) Working with documents
2, Installation configuration of Flume
1. Download and upload to the server
Copy fl ...
Added by future_man on Sun, 09 Jan 2022 10:17:28 +0200
1. flume is a distributed, reliable and highly available system for massive log collection, aggregation and transmission. Support customization of various data senders in the log system for data collection; At the same time, flume provides the ability to simply process data and write to various data recipien ...
Added by Josien on Thu, 09 Dec 2021 17:38:58 +0200
Advances in flume learning
The primary purpose is to ensure data consistency, either with success or with failure.
Flume Agent Internal Principles
To summarize: That is to say Source Collected in event Not directly to channel Instead, a ChannelProcessor,this processor Will let us event Goes ...
Added by Jax2 on Mon, 11 Oct 2021 19:39:19 +0300
1. What is Flume?
1.1. Definition of flume
1.2, architecture of flume
2. Introduction to Flume
2.1, Download flume
2.2. Install flume
2.3. Small flume cases
2.3.1. Official Case - Monitoring Port
2.3.2, Real-time monitoring of individual appended files
2.3.3, Multiple files under Real-time Monitoring Directory
Added by uidzer0 on Sat, 11 Sep 2021 20:01:27 +0300