Elk -- grok regular filtering Linux system login log

Filter Linux system login log / var/log/secure Landing successfully Jan 6 17:11:47 localhost sshd[3324]: Received disconnect from 172.16.0.13: 11: disconnected by user Jan 6 17:11:47 localhost sshd[3324]: pam_unix(sshd:session): session closed for user root Jan 6 17:11:48 localhost sshd[3358]: Address 172.16.0.13 maps to localhost, but this ...

Added by sheephat on Sun, 01 Dec 2019 22:06:30 +0200

Mysql data synchronization to elastic search in Docker environment

Written in front There are generally two principles to implement mysql data synchronization es: The synchronization is performed through the regular query of sql statement. elasticsearch-jdbc [logstash JDBC] official( https://www.elastic.co/blog/l... Use binlog for synchronization Big God's open source project go-mysql-elasticsearch T ...

Added by Pinkmischief on Wed, 27 Nov 2019 18:47:58 +0200

Talk about the SeedHostsProvider of elastic search

order This paper mainly studies the seedhosts provider of elastic search SeedHostsProvider elasticsearch-7.0.0/server/src/main/java/org/elasticsearch/discovery/SeedHostsProvider.java /** * A pluggable provider of the list of seed hosts to use for discovery. */ public interface SeedHostsProvider { /** * Returns a list of seed hosts t ...

Added by Rangel on Thu, 21 Nov 2019 22:40:15 +0200

EFK Tutorial - ElasticSearch Role Separation

Build a high performance + high availability ES architecture by separating the data, ingest, master roles of elasticsearch Author: "The Wolf of Britain", welcome to reprint and submit Catalog _Purpose_Architecture_Step description_elasticsearch-data deployment_elasticsearch-ingest deployment_elasticsearch-master deployment purpose ...

Added by Cameri on Fri, 15 Nov 2019 03:17:43 +0200

Self developed composer package of lumen

Take my zero / lumen elastic search package as an example Note that this plug-in uses the lumen framework 1. Installation dependency composer require zzq/lumen-elasticsearch 2. Create the elasticsearch.php configuration file with the following contents: <?php return [ /** * You can specify one of several different connections whe ...

Added by ThaSpY on Wed, 13 Nov 2019 16:24:15 +0200

Talk about LagDetector of elastic search

order This paper mainly studies the LagDetector of elastic search LagDetector elasticsearch-7.0.1/server/src/main/java/org/elasticsearch/cluster/coordination/LagDetector.java /** * A publication can succeed and complete before all nodes have applied the published state and acknowledged it; however we need every node * eventually either to app ...

Added by dmayo2 on Tue, 12 Nov 2019 00:32:30 +0200

Deploying ELK log analysis system based on Docker container

Deploy elk log analysis system to consume more computer hardware. If you use virtual machine for test deployment, it is recommended to allocate more hardware resources. Otherwise, when elk container is running, it will not work normally. I will allocate 5G of memory to the docker host, four CPU s. I. environmental preparation I use a docker ho ...

Added by Jack Sparrow on Sat, 02 Nov 2019 01:55:08 +0200

Talk about SizeBlockingQueue of Elasticsearch

order This paper focuses on the SizeBlockingQueue of elastic search SizeBlockingQueue elasticsearch-7.0.1/server/src/main/java/org/elasticsearch/common/util/concurrent/SizeBlockingQueue.java public class SizeBlockingQueue<E> extends AbstractQueue<E> implements BlockingQueue<E> { private final BlockingQueue<E> queue; ...

Added by shortysbest on Fri, 01 Nov 2019 19:01:44 +0200

Using IK word breakers, extending IK word banks, and stopping word banks

Using IK word breakers Integrated ik word breaker https://mp.csdn.net/postedit/93602713 Entity class PosEntity /** Omit getter and setter*/ class PosEntity{ private Integer posId; private String posName; private String posAddress; } In entity class, posName and posAddress are both used as Chinese fields, a ...

Added by tomm098 on Thu, 31 Oct 2019 10:41:32 +0200

The latest Centos7.6 deployment of ELK log analysis system

Download elastic search Create elk user and authorize useradd elk chown -R elk:elk /home/elk/elasticsearch chown -R elk:elk /home/elk/elasticsearch1 chown -R elk:elk /home/elk/elasticsearch2 mkdir -p /home/eladata mkdir -p /var/log/elk chown -R elk:elk /home/eladata chown -R elk:elk /var/log/elk Master node master Extract from elastic search an ...

Added by crochk on Tue, 22 Oct 2019 19:50:52 +0300