How to deploy dolphin scheduler Apache Dolphin Scheduler 1.2.0 in CDH5.16.2
Apache Dolphin Scheduler
Component introduction
Distributed and extensible visual DAG workflow task scheduling system. It is committed to solving the complex dependencies in the data processing process, so that the scheduling system can be used out of the box in the data processing process.
Official website: https://dolphinscheduler.apache.o ...
Added by flunn on Thu, 02 Sep 2021 00:58:00 +0300
90 lines of python code make wechat earth turn
1. Wechat earth
When you open wechat, you will see a famous picture of Zhang Xiaolong standing on it.
Have you ever thought about such a question, what would happen if the earth above turned?
2. Renderings
3. Material preparation
Here we need to prepare three materials: 1. The material of the earth's surface; 2. The material of cloud map; 3. ...
Added by iceraider on Mon, 29 Jun 2020 07:41:22 +0300
The first experience of flink streaming sql
Article catalog
background
Example explanation
Construct the StreamTableEnvironment object
Register table
Using Tuple
Using Row
Pojo class using java
Use external storage
background
sql,Structured Query Language: as a general and popular query language, Structured Query Language is becomin ...
Added by TodManPlaa on Sun, 21 Jun 2020 07:16:31 +0300
numpy: a common module in python
Reference video: Start Python data mining in 4 days
1 Numpy advantage
1.1 introduction to numpy
Numpy (Numerical Python) is an open-source Python science computing library, which is used to quickly process arrays of any dimension. (numerical → \ to → numerical)
Numpy supports common arr ...
Added by AnarKy on Tue, 16 Jun 2020 09:31:42 +0300
MapReduce actual case, MapTask operation mechanism, ReduceTask operation mechanism, MapReduce execution process, hadoop data compression, implementation of Join algorithm
MapReduce actual case, MapTask operation mechanism, ReduceTask operation mechanism, MapReduce execution process, hadoop data compression, implementation of Join algorithm
MapReduce actual case
Reverse order of upstream traffic
Cell phone number division
MapTask operation mechanism
Operation proces ...
Added by Fergal Andrews on Sat, 13 Jun 2020 09:39:07 +0300
CDH6.3.2 Enable Kerberos integration using phoenix
Tags (space delimited): building large data platforms
1. Download and install Phoenix parcel
2. Install CSD files
3. Add Phoenix service in Cloudera Manager (provided HBase service is installed)
4. Configure HBase for Phoenix
V. Verify Phoenix installation and smoke test
6. Import Data Validation Test
7. Integration of phoinex schema with ...
Added by lszanto on Thu, 04 Jun 2020 19:45:25 +0300
Details of Zookeeper data structure
Zookeeper
https://zookeeper.apache.org/doc/current/zookeeperOver.html
ZooKeeper is a distributed, open-source coordination service for distributed applications.
It exposes a simple set of primitives that distributed applications can build upon to implement higher level services for synchronization, configuration maintenance, and groups and nami ...
Added by sfmnetsys on Sun, 24 May 2020 12:33:08 +0300
python notes: drawing Nightingale rose with pyecharts
Recently, "Nightingale rose map" has caught fire all over the Internet due to the people's Daily's report of the epidemic. Used to see pie chart, at first contact with this chart, it is inevitable to be amazed by its visual impact. Since I have been studying Python for the past two years, I am now ready to use Python to make Nightinga ...
Added by Yrogerg on Wed, 13 May 2020 21:42:52 +0300
HDFS - operation and maintenance
1, Add node
Operating system configuration: ① host name, network, firewall, ssh configuration
ssh-keygen -t rsa
At the same time, the auth*-keys file of ssh of any node in the cluster can be distributed to the latest node
Add the domain name mapping of this node in the / etc/hosts file of all nodes
Copy the configuration file of namenode to ...
Added by Rayman3.tk on Wed, 06 May 2020 02:22:05 +0300
Complete experiment: statistical feature calculation of monitoring data based on spectral data
1. EXPERIMENTAL DATA
Links: https://pan.baidu.com/s/1CSgRQ8OXe50ya_DwkLX8yw
Extraction Code: kexq
2. Experimental Background
1.1 Experimental Background
(1) On-line monitoring of power equipment
On-line monitoring of power equipment refers to the continuous or periodic automatic monitoring and detection of the condition of power equipment with ...
Added by nuxy on Fri, 01 May 2020 11:58:03 +0300