11. kafka Management Client Interface

Preface Usually, we are used to using script tools under bin directory in Kafka to manage and view Kafka, but sometimes we need to integrate some functions of management and view into the system (such as Kafka Manager), so we need to call some API s to operate Kafka directly. Before Kafka version 0.11 ...

Added by rnewman on Tue, 13 Aug 2019 10:32:55 +0300

Java Implementation of Kafka Tools and the like in 59-Dawn Big Data Classic Big Data Written Test Series

Tool Class Meaning Description kafka is one of the most typical and commonly used MQ technologies. It has gradually developed into a middleware for decoupling components of producers and consumers. code implementation Producer Tools package com.tl.job002.kafka; import java.util.Properties; import o ...

Added by olko on Tue, 30 Jul 2019 14:05:03 +0300

KafkaMirror Maker Setup Notes

Luckily, Kafka Mirror Maker was used to synchronize data in both locations. Here's your personal notes (not finished). Open JMX Monitoring Kafka's sensitive data using JMX requires opening the JMX port, which can be achieved by setting environment variables.My own practice is to add the following configuration to the kafka-server-start.sh scri ...

Added by cheesemunger on Mon, 29 Jul 2019 04:14:58 +0300

ELK Unified Log Management Platform Part 3 - The Use of Logstash Group Plug-ins

1. ELK Unified Log Management Platform Part 3 - The Use of Logstash Group Plug-ins In this blog, I will mainly explain the following knowledge points and practical experience for your reference: _1. Standard Specification for Log Content of JAVA Applications: _2. How to use the grok plug-in of logstash to split the message field? _3. Delete th ...

Added by new7media on Thu, 27 Jun 2019 00:34:23 +0300