Programming VIP

This paper mainly introduces the environment deployment and configuration of ELK related components, and takes the system syslog as the source data input to test and verify the data reception of elasticsearch and the data display of Kibana. 1. Introduction to basic concepts and environment configuration 1.1 basic concept of Elk ELK is an o ...

From the service gateway: Microservices series: introduction to Spring Cloud Gateway I've always learned about distributed transactions: Microservices series: distributed transaction Spring Cloud Alibaba's Seata practical chapter Today, we are finally going to end our micro service series. Not surprisingly, distributed logging will be the last ...

This article mainly talks about the real experience in work, how to build a 100 million log platform, and teach you how to establish such a 100 million ELK system. For the specific development process of the log platform, please refer to the previous chapter "Evolution from ELK to EFK" No more nonsense. The old drivers are seated a ...

1. Load external profile 1.1 Input config filebeat.config.inputs: enabled: true path: inputs.d/*.yml inputs. Example of configuration file in D Directory: - type: log paths: - /var/log/mysql.log scan_frequency: 10s - type: log paths: - /var/log/apache.log scan_frequency: 5s 1.2 Module config filebeat.config.modu ...

I Instructions before installation The following steps are operated in centos 7 in VMware. The ip address is 192.168.161.128; Note that it's best to unify the version when installing, otherwise many problems will appear later. Search the official website for the corresponding image and check the version under the Tags tag. At present, my ...

1. Premise preparation 1.1 online installation jdk 1.1.1 is jdk installed The operation of Elasticsearch requires a JDK environment, but the version above Elasticsearch 7 will bring its own JDK (the installation package has changed from tens of megabytes to hundreds of megabytes, which is why), and the version above Elasticsearch 7 needs jdk ...

Combined with the use of ELK as a log management tool in the project, it has been integrated and introduced earlier Elasticsearch In the project, two Logstash nodes are deployed to consume messages from Kafka cluster and output them to Elasticsearch cluster for log data storage. Combined with project practice, official website and other net ...

ELK overview 1, ELK introduction The elk platform consists of ElasticSearch, Logstash and Kiabana 1. ElasticSearch: it is a distributed storage and retrieval engine developed based on Lucene (a full-text retrieval engine architecture), which is used to store all kinds of logs. The advantage is that it can store, search and analyze large c ...

Project 1: elasticsearch migration scheme elasticsearch index migration View reference documents: https://www.elastic.co/guide/en/elasticsearch/reference/7.15/docs-reindex.html Add the white list of ES clusters to be migrated to the destination es configuration file elasticsearch yml reindex.remote.whitelist: "otherhost:9200, another:9200, ...

ELK - log collection system 1. What logs do you want to collect? ① System log – prepare for monitoring ② Service log – database – MySQL – slow query log, error log and normal log ③ Business log – log4j (business log must be collected) Note: log4j - data business log of Java class (1) To be targeted to collect ...