Programming VIP

Flink Core Programming 1,Environment When Flink Job submits to perform calculations, it first establishes a link with the Flink framework, that is, the current Flink runtime environment in which task can be scheduled to a different taskManager execution only if environmental information is available. This environment object is relatively simp ...

Rack awareness Usually, large Hadoop clusters are distributed on many racks. In this case, It is hoped that the communication between different nodes can occur within the same rack rather than across racks. In order to improve fault tolerance, the name node will place copies of data blocks on multiple racks as much as possible. Considering th ...

The HDFS cluster consists of a master / slave architecture. A single server running the NameNode process is the master node server, and multiple servers running the DataNode process are slave node servers Installation preparation host nameIP addressThe server node-01 192.168.229.21 NameNode server, DataNode server node-02 192.168.229.2 ...

1, Introduction to big data 1. Data and data analysis 2. Role of data analysis Current situation analysisCause analysisForecast analysis 3. Basic steps of data analysis Clarify the purpose of analysisdata collectiondata processingData analysisData presentationReport writing 4. Big data What is big dataThe challenge of massive dataCharac ...

Hadoop practice (2)Author WenasWeiprefaceIn the previous Hadoop practical chapter, I introduced the local mode and pseudo cluster mode installation of Hadoop offline batch processing technology. Next, I will continue to learn the Hadoop cluster mode installation; It will be introduced from the following points:Linux host deployment planningZook ...

1, Previously on The last article introduced the Api calling method of MapReduce and the configuration of eclipse. This time, we will use MapReduce to count words in English article files! Welcome to my previous article: MapReduce related eclipse configuration and Api call 2, Preconditions Installation requiredDownload methodIDEAO ...

hive built-in function In Hive, functions are mainly divided into two types: built-in functions and user-defined functions. Function view show functions; desc function functionName; Date function 1) Current system time function: current_date(). current_timestamp(),unix_timestamp() -- Function 1:current_date(); Current system date format: ...

JMX_Expotermonitor At present, CDH and HDP will merge closed source in the future. The company plans to spend time developing a similar platform. I have also made some efforts in cluster monitoring. monitor For a cluster management platform, the first thing to bear the brunt is how to realize the monitoring. After all, many times we open ...

Author: duktig Blog: https://duktig.cn (first article) Excellent still work hard. May you enjoy what you give and enjoy what you get. See github knowledge base for more articles: https://github.com/duktig666/knowledge background After learning Hadoop, do you feel that writing a MapReduce program is very complex, and it requires a lot ...

Software Architecture Experiment 2 1. Simple Translator for Implementing Four Operations 1.1 Requirements Implements four operations of addition, subtraction, multiplication and division, allowing multiple operands at the same time, such as 4+6*5-8 resulting in 26;The operand is an integer, which can have multiple bits.Handle spaces;The inpu ...