Programming VIP

definition In addition to retrieval, ES also provides statistical analysis of data, with high real-time performance Bucket aggregation Filter out documents that meet specific criteria: GET kibana_sample_data_flights/_search { "size": 0, "aggs": { "dest": { "terms": { "field": "DestCountry" } } } } The ...

JUC Foundation 1. Tube side: monitor, monitor, lock It ensures that only one process is active in the pipe at the same time, that is, the operations defined in the pipe are called by only one process at the same time (implemented by the compiler) However, this does not guarantee that the processes are executed in the designed order Synchroni ...

Flink multi parallelism and WaterMark Recently, when reviewing flink, I found that the demo s written before are all single parallelism. Is the window trigger under the sudden fantasy multi parallelism the same as the single parallelism? Therefore, the following problems are extended. First, I set the data delay time to 2s, and then set a ...

Spark-SQL summary Spark SQL is a spark module used by spark for structured data processing. For developers, SparkSQL can simplify the development of RDD, improve the development efficiency, and the execution efficiency is very fast. Therefore, in practical work, SparkSQL is basically used. In order to simplify the development of RDD and impr ...

Senior Development Engineer of big dataWhy return a unified canonical format for SpringBootUnder the condition of acquiescence, there are three common return formats of SpringBoot:First: return String@GetMapping("/hello")public String getStr(){ return "hello,javadaily";}Copy codeAt this time, the return value obtained by calling the interface ...

MergeTree¶ Family (LSM tree data structure) Replicated + MergeTree = replicated MergeTree MergeTree : Replaceingmergetree: de duplication of data with the same sort key during background data consolidation. SummingMergeTree: when merging data, records with the same primary key will be merged into one record. According to the aggregation fi ...

(1) Preparation: Linux uses CentOS-7-x86 Official website download address: https://archive.kernel.org/centos-vault/7.6.1810/isos/x86_64/ Virtual machine VMware Workstation 16 Pro I know everything on this website Hadoop installation package version: hadoop-2.7.4 Official website download address: https://archive.apache.org/dist/hadoop/co ...

Section 1 Introduction to spark 1. What is spark? 1.apache spark is a unified computing engine and a set of class libraries. Using spark to process data is 100 times faster than the traditional way. 2. It is not that spark is 100 times faster than python on a single computer, but that spark is mainly used for parallel data processing on c ...

Tiktok protocol, buffet crawler, interface analysis, search, tiktok recommendation, city recommendation, fan list, etc. Tiktok search interface Interface nametypelinkSearch user comprehensive informationposthttps://aweme-hl.snssdk.com/aweme/v1/challenge/search/?Search related user listposthttps://search-hl.amemv.com/aweme/v1/discover/search ...

Functional programming Object oriented programming OOP solve the problem Decompose objects, behaviors and attributes, and then solve problems through object relationships and behavior calls. Objects: users Behavior: login, JDBC, read database Attributes: user name, password Scala is a completely object-oriented programming language The nature o ...