Elk -- grok regular filtering Linux system login log
Filter Linux system login log / var/log/secure
Landing successfully
Jan 6 17:11:47 localhost sshd[3324]: Received disconnect from 172.16.0.13: 11: disconnected by user
Jan 6 17:11:47 localhost sshd[3324]: pam_unix(sshd:session): session closed for user root
Jan 6 17:11:48 localhost sshd[3358]: Address 172.16.0.13 maps to localhost, but this ...
Added by sheephat on Sun, 01 Dec 2019 22:06:30 +0200
Mysql data synchronization to elastic search in Docker environment
Written in front
There are generally two principles to implement mysql data synchronization es:
The synchronization is performed through the regular query of sql statement.
elasticsearch-jdbc
[logstash JDBC] official( https://www.elastic.co/blog/l...
Use binlog for synchronization
Big God's open source project go-mysql-elasticsearch
T ...
Added by Pinkmischief on Wed, 27 Nov 2019 18:47:58 +0200
Talk about the SeedHostsProvider of elastic search
order
This paper mainly studies the seedhosts provider of elastic search
SeedHostsProvider
elasticsearch-7.0.0/server/src/main/java/org/elasticsearch/discovery/SeedHostsProvider.java
/**
* A pluggable provider of the list of seed hosts to use for discovery.
*/
public interface SeedHostsProvider {
/**
* Returns a list of seed hosts t ...
Added by Rangel on Thu, 21 Nov 2019 22:40:15 +0200
EFK Tutorial - ElasticSearch Role Separation
Build a high performance + high availability ES architecture by separating the data, ingest, master roles of elasticsearch
Author: "The Wolf of Britain", welcome to reprint and submit
Catalog
_Purpose_Architecture_Step description_elasticsearch-data deployment_elasticsearch-ingest deployment_elasticsearch-master deployment
purpose ...
Added by Cameri on Fri, 15 Nov 2019 03:17:43 +0200
Self developed composer package of lumen
Take my zero / lumen elastic search package as an example
Note that this plug-in uses the lumen framework
1. Installation dependency
composer require zzq/lumen-elasticsearch
2. Create the elasticsearch.php configuration file with the following contents:
<?php
return [
/**
* You can specify one of several different connections whe ...
Added by ThaSpY on Wed, 13 Nov 2019 16:24:15 +0200
Talk about LagDetector of elastic search
order
This paper mainly studies the LagDetector of elastic search
LagDetector
elasticsearch-7.0.1/server/src/main/java/org/elasticsearch/cluster/coordination/LagDetector.java
/**
* A publication can succeed and complete before all nodes have applied the published state and acknowledged it; however we need every node
* eventually either to app ...
Added by dmayo2 on Tue, 12 Nov 2019 00:32:30 +0200
Deploying ELK log analysis system based on Docker container
Deploy elk log analysis system to consume more computer hardware. If you use virtual machine for test deployment, it is recommended to allocate more hardware resources. Otherwise, when elk container is running, it will not work normally. I will allocate 5G of memory to the docker host, four CPU s.
I. environmental preparation
I use a docker ho ...
Added by Jack Sparrow on Sat, 02 Nov 2019 01:55:08 +0200
Talk about SizeBlockingQueue of Elasticsearch
order
This paper focuses on the SizeBlockingQueue of elastic search
SizeBlockingQueue
elasticsearch-7.0.1/server/src/main/java/org/elasticsearch/common/util/concurrent/SizeBlockingQueue.java
public class SizeBlockingQueue<E> extends AbstractQueue<E> implements BlockingQueue<E> {
private final BlockingQueue<E> queue; ...
Added by shortysbest on Fri, 01 Nov 2019 19:01:44 +0200
Using IK word breakers, extending IK word banks, and stopping word banks
Using IK word breakers
Integrated ik word breaker https://mp.csdn.net/postedit/93602713
Entity class PosEntity
/** Omit getter and setter*/
class PosEntity{
private Integer posId;
private String posName;
private String posAddress;
}
In entity class, posName and posAddress are both used as Chinese fields, a ...
Added by tomm098 on Thu, 31 Oct 2019 10:41:32 +0200
The latest Centos7.6 deployment of ELK log analysis system
Download elastic search
Create elk user and authorize
useradd elk
chown -R elk:elk /home/elk/elasticsearch
chown -R elk:elk /home/elk/elasticsearch1
chown -R elk:elk /home/elk/elasticsearch2
mkdir -p /home/eladata
mkdir -p /var/log/elk
chown -R elk:elk /home/eladata
chown -R elk:elk /var/log/elk
Master node master
Extract from elastic search an ...
Added by crochk on Tue, 22 Oct 2019 19:50:52 +0300