This paper mainly introduces the environment deployment and configuration of ELK related components, and takes the system syslog as the source data input to test and verify the data reception of elasticsearch and the data display of Kibana.
1. Introduction to basic concepts and environment configuration
1.1 basic concept of Elk
ELK is an o ...
From the service gateway: Microservices series: introduction to Spring Cloud Gateway I've always learned about distributed transactions: Microservices series: distributed transaction Spring Cloud Alibaba's Seata practical chapter Today, we are finally going to end our micro service series. Not surprisingly, distributed logging will be the last ...
Added by knelson on Wed, 23 Feb 2022 03:24:48 +0200
This article mainly talks about the real experience in work, how to build a 100 million log platform, and teach you how to establish such a 100 million ELK system. For the specific development process of the log platform, please refer to the previous chapter "Evolution from ELK to EFK"
No more nonsense. The old drivers are seated a ...
Added by ciaran on Sat, 19 Feb 2022 19:44:17 +0200
I Instructions before installation
The following steps are operated in centos 7 in VMware. The ip address is 192.168.161.128; Note that it's best to unify the version when installing, otherwise many problems will appear later. Search the official website for the corresponding image and check the version under the Tags tag. At present, my ...
Added by foreknowapparel on Wed, 09 Feb 2022 10:01:42 +0200
1. Premise preparation
1.1 online installation jdk
1.1.1 is jdk installed
The operation of Elasticsearch requires a JDK environment, but the version above Elasticsearch 7 will bring its own JDK (the installation package has changed from tens of megabytes to hundreds of megabytes, which is why), and the version above Elasticsearch 7 needs jdk ...
Added by jeff21 on Tue, 08 Feb 2022 23:40:16 +0200
Combined with the use of ELK as a log management tool in the project, it has been integrated and introduced earlier Elasticsearch In the project, two Logstash nodes are deployed to consume messages from Kafka cluster and output them to Elasticsearch cluster for log data storage. Combined with project practice, official website and other net ...
Added by Edgewalker81 on Sat, 22 Jan 2022 16:00:47 +0200
1, ELK introduction
The elk platform consists of ElasticSearch, Logstash and Kiabana
1. ElasticSearch: it is a distributed storage and retrieval engine developed based on Lucene (a full-text retrieval engine architecture), which is used to store all kinds of logs. The advantage is that it can store, search and analyze large c ...
Added by meltingpotclub on Sun, 16 Jan 2022 10:58:58 +0200
Project 1: elasticsearch migration scheme
elasticsearch index migration
View reference documents: https://www.elastic.co/guide/en/elasticsearch/reference/7.15/docs-reindex.html
Add the white list of ES clusters to be migrated to the destination es configuration file elasticsearch yml
reindex.remote.whitelist: "otherhost:9200, another:9200, ...
Added by tucker on Mon, 10 Jan 2022 16:38:16 +0200
ELK - log collection system
1. What logs do you want to collect?
① System log – prepare for monitoring
② Service log – database – MySQL – slow query log, error log and normal log
③ Business log – log4j (business log must be collected)
Note: log4j - data business log of Java class
(1) To be targeted to collect ...
Added by recset on Tue, 04 Jan 2022 03:26:51 +0200