How to deploy dolphin scheduler Apache Dolphin Scheduler 1.2.0 in CDH5.16.2

Apache Dolphin Scheduler Component introduction Distributed and extensible visual DAG workflow task scheduling system. It is committed to solving the complex dependencies in the data processing process, so that the scheduling system can be used out of the box in the data processing process. Official website: https://dolphinscheduler.apache.o ...

Added by flunn on Thu, 02 Sep 2021 00:58:00 +0300

90 lines of python code make wechat earth turn

1. Wechat earth When you open wechat, you will see a famous picture of Zhang Xiaolong standing on it. Have you ever thought about such a question, what would happen if the earth above turned? 2. Renderings 3. Material preparation Here we need to prepare three materials: 1. The material of the earth's surface; 2. The material of cloud map; 3. ...

Added by iceraider on Mon, 29 Jun 2020 07:41:22 +0300

The first experience of flink streaming sql

Article catalog background Example explanation Construct the StreamTableEnvironment object Register table Using Tuple Using Row Pojo class using java Use external storage background sql,Structured Query Language: as a general and popular query language, Structured Query Language is becomin ...

Added by TodManPlaa on Sun, 21 Jun 2020 07:16:31 +0300

numpy: a common module in python

Reference video: Start Python data mining in 4 days 1 Numpy advantage 1.1 introduction to numpy Numpy (Numerical Python) is an open-source Python science computing library, which is used to quickly process arrays of any dimension. (numerical → \ to → numerical) Numpy supports common arr ...

Added by AnarKy on Tue, 16 Jun 2020 09:31:42 +0300

MapReduce actual case, MapTask operation mechanism, ReduceTask operation mechanism, MapReduce execution process, hadoop data compression, implementation of Join algorithm

MapReduce actual case, MapTask operation mechanism, ReduceTask operation mechanism, MapReduce execution process, hadoop data compression, implementation of Join algorithm MapReduce actual case Reverse order of upstream traffic Cell phone number division MapTask operation mechanism Operation proces ...

Added by Fergal Andrews on Sat, 13 Jun 2020 09:39:07 +0300

CDH6.3.2 Enable Kerberos integration using phoenix

Tags (space delimited): building large data platforms 1. Download and install Phoenix parcel 2. Install CSD files 3. Add Phoenix service in Cloudera Manager (provided HBase service is installed) 4. Configure HBase for Phoenix V. Verify Phoenix installation and smoke test 6. Import Data Validation Test 7. Integration of phoinex schema with ...

Added by lszanto on Thu, 04 Jun 2020 19:45:25 +0300

Details of Zookeeper data structure

Zookeeper https://zookeeper.apache.org/doc/current/zookeeperOver.html ZooKeeper is a distributed, open-source coordination service for distributed applications. It exposes a simple set of primitives that distributed applications can build upon to implement higher level services for synchronization, configuration maintenance, and groups and nami ...

Added by sfmnetsys on Sun, 24 May 2020 12:33:08 +0300

python notes: drawing Nightingale rose with pyecharts

Recently, "Nightingale rose map" has caught fire all over the Internet due to the people's Daily's report of the epidemic. Used to see pie chart, at first contact with this chart, it is inevitable to be amazed by its visual impact. Since I have been studying Python for the past two years, I am now ready to use Python to make Nightinga ...

Added by Yrogerg on Wed, 13 May 2020 21:42:52 +0300

HDFS - operation and maintenance

1, Add node Operating system configuration: ① host name, network, firewall, ssh configuration ssh-keygen -t rsa At the same time, the auth*-keys file of ssh of any node in the cluster can be distributed to the latest node Add the domain name mapping of this node in the / etc/hosts file of all nodes Copy the configuration file of namenode to ...

Added by Rayman3.tk on Wed, 06 May 2020 02:22:05 +0300

Complete experiment: statistical feature calculation of monitoring data based on spectral data

1. EXPERIMENTAL DATA Links: https://pan.baidu.com/s/1CSgRQ8OXe50ya_DwkLX8yw Extraction Code: kexq 2. Experimental Background 1.1 Experimental Background (1) On-line monitoring of power equipment On-line monitoring of power equipment refers to the continuous or periodic automatic monitoring and detection of the condition of power equipment with ...

Added by nuxy on Fri, 01 May 2020 11:58:03 +0300