Programming VIP

Reflection mechanism and Application What is reflection In the program running state, for any class or object, all properties and methods of the class (including private properties and methods) can be obtained. This function of dynamically obtaining information and dynamically calling object methods is called reflection mechanism. In short, ...

catalogue ​​​​​​0. Links to related articles 1. union and connect operators 2. split, select and Side Outputs 3. rebalance partition 4. Other partition operators ​​​​​​0. Links to related articles 1. union and connect operators API: Union: the union operator can merge multiple data streams of the same type and generate data strea ...

Replica fragmentation request process, function entry: industriesclusterstateservice createOrUpdateShards org.elasticsearch.indices.cluster.IndicesClusterStateService private void createOrUpdateShards(final ClusterState state) { RoutingNode localRoutingNode = state.getRoutingNodes().node(state.nodes().getLocalNodeId()); if ...

catalogue Code block a. Local code block: b. Construction code block: c. Static code block inherit Inheritance overview Succession list Benefits of inheritance Characteristics of inheritance in Java Considerations for inheritance in Java Relationship of member variables in inheritance super keyword Relationship between construction ...

Spark Learning: using idea to develop spark applications This article is based on jdk1 8. The idea development tool and maven are all configured. background Because saprk service has been deployed on the remote centos server, but the code of spark based application is developed in the local idea, how to make the locally developed spark code ...

Welcome to my Personal blog Learn more transform Function: convert the South data (source data) into the required data Common functions map The map operator is similar to the map in python. In python, the data is converted into the data in lambda expression, while the map in flink is more extensive. Through a new Mapfunction, the user-defi ...

1. Build table songsong,bingbing_lili,xiao song:18_xiaoxiao song:19,hui long guan_beijing yangyang,caicai_susu,xiao yang:18_xiaoxiao yang:19,chao yang_beijing create table if not exists test( name string, friends array<string>, children map<string, int>, address struct<street:string, city:string> ) row format delimited ...

Flume 1, Overview 1.Flume definition Flume is a highly available, reliable and distributed system for massive log collection, aggregation and transmission provided by Cloudera. Flume is based on streaming architecture, which is flexible and simple. 2.Flume advantages ① It can be integrated with any storage process ② When th ...

When it comes to anomaly detection, the main challenge is that it is difficult to define anomalies. For example, how can we define and predict abnormal network intrusion, system defects and security fraud? If known exception data has been marked, we can choose from the various types of supervised machine learning models (see the link below fo ...

Analysis of kafka consumption message source code Example code of consumption message package com.example.demo.kafka; import org.apache.kafka.clients.consumer.ConsumerConfig; import org.apache.kafka.clients.consumer.ConsumerRecord; import org.apache.kafka.clients.consumer.ConsumerRecords; import org.apache.kafka.clients.consumer.KafkaCon ...