Steps to build a cluster environment
*How to transfer files from Mac to virtual machine:
Connect the host as follows: Transfer file: scp file location and file name root@IP Address: the location where files need to be stored
1. Configure NAT network
Note: change the network adapter of vm to NAT mode
edit /etc/sysconfig/network-scripts/ifcfg-ens33 file
Modified as BOOTPR ...
Added by brandon on Wed, 09 Mar 2022 17:00:28 +0200
In depth analysis of MySQL Partition function
=Horizontal partition (by row according to column attribute)=
Take a simple example: a table containing ten-year invoice records can be divided into ten different partitions, and each partition contains the records of one year.
Mode of horizontal partition:
Range – this mode allows DBA s to divide data into different ranges. For e ...
Added by tobimichigan on Wed, 09 Mar 2022 13:13:19 +0200
Elasticsearch problems and Solutions
1. Type problem
When you create an index directly, the default type is set to_ doc.
You can also use put below to specify the type, and then delete this document. Hehe. Does it implement an empty and typed index
PUT / index name / type name (can not be directly replaced by _doclater) / document id
{
Request body
}
2. Field type in docu ...
Added by morganchia on Wed, 09 Mar 2022 12:01:36 +0200
Calculation of ring ratio and N kinds of posture year-on-year
When doing data analysis, we often hear the concepts of year-on-year and month on month. When publishing statistical data, enterprises and organizations usually like to compare the previous historical data with the year-on-year and month on month data to illustrate the changes of the data. For example, the Bureau of Statistics announced that in ...
Added by unreal128 on Wed, 09 Mar 2022 07:46:56 +0200
Hive window function Over partition by
-Catalogue
1. Aggregate function + over2. partition by clause3. order by clause4. ★ window clause (included) - predicting: forward - FOLLOWING: backward - CURRENT ROW: CURRENT ROW - UNBOUNDED: starting point5. ★ sequence function in window function: including NTILE(n), row_number,rank,dense_rank
brief introduction
The hive function in this ...
Added by BigTime on Tue, 08 Mar 2022 23:46:16 +0200
Graphic big data | Spark machine learning - workflow and Feature Engineering
Author: Han Xinzi@ShowMeAI Tutorial address: http://www.showmeai.tech/tutorials/84 Article address: http://www.showmeai.tech/article-detail/180 Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the source
1.Spark machine learning workflow
1) Spark mllib and ml
Spark also has MLlib/ML for big d ...
Added by nunomira on Tue, 08 Mar 2022 18:14:48 +0200
Graphic big data | comprehensive case - mining music album data using Spark analysis
Author: Han Xinzi@ShowMeAITutorial address: http://www.showmeai.tech/tutorials/84Article address: http://www.showmeai.tech/article-detail/178Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the sourceintroductionThis is one of the most widely used cases of video and audio data processing of HDFS, ...
Added by Spoiler on Tue, 08 Mar 2022 17:26:31 +0200
Open source vector database -- milvus
Milvus is an open source vector similarity search engine, which supports the addition, deletion and modification of TB level vectors and near real-time query. It has the characteristics of high flexibility, stability, reliability and high-speed query. Milvus integrates widely used vector index libraries such as Faiss, NMSLIB and Annoy, and prov ...
Added by dibyendrah on Tue, 08 Mar 2022 16:49:49 +0200
Data synchronization between Clickhouse and Kafka
Author: Lemon Nan
Original address: https://mp.weixin.qq.com/s/SUUHF9R_FKg-3vq7Q3cwBQ
The original text and address shall be indicated
introduce
Clickhouse itself is an analytical database, which provides many synchronization schemes with other components. This paper will take Kafka as the data source to introduce how to synchronize Kaf ...
Added by muppet on Tue, 08 Mar 2022 16:31:27 +0200
Illustrating big data covid-19 case analysis of new crown pneumonia epidemic data using spark
Author: Han Xinzi@ShowMeAITutorial address: http://www.showmeai.tech/tutorials/84Article address: http://www.showmeai.tech/article-detail/176Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the sourceintroduction2020, since covid-19 has changed the world and affects everyone's life, this case comb ...
Added by subwayman on Tue, 08 Mar 2022 16:24:06 +0200