Steps to build a cluster environment

*How to transfer files from Mac to virtual machine: Connect the host as follows: Transfer file: scp file location and file name root@IP Address: the location where files need to be stored 1. Configure NAT network Note: change the network adapter of vm to NAT mode edit /etc/sysconfig/network-scripts/ifcfg-ens33 file Modified as BOOTPR ...

Added by brandon on Wed, 09 Mar 2022 17:00:28 +0200

In depth analysis of MySQL Partition function

=Horizontal partition (by row according to column attribute)= Take a simple example: a table containing ten-year invoice records can be divided into ten different partitions, and each partition contains the records of one year. Mode of horizontal partition: Range – this mode allows DBA s to divide data into different ranges. For e ...

Added by tobimichigan on Wed, 09 Mar 2022 13:13:19 +0200

Elasticsearch problems and Solutions

1. Type problem When you create an index directly, the default type is set to_ doc. You can also use put below to specify the type, and then delete this document. Hehe. Does it implement an empty and typed index PUT / index name / type name (can not be directly replaced by _doclater) / document id { Request body } 2. Field type in docu ...

Added by morganchia on Wed, 09 Mar 2022 12:01:36 +0200

Calculation of ring ratio and N kinds of posture year-on-year

When doing data analysis, we often hear the concepts of year-on-year and month on month. When publishing statistical data, enterprises and organizations usually like to compare the previous historical data with the year-on-year and month on month data to illustrate the changes of the data. For example, the Bureau of Statistics announced that in ...

Added by unreal128 on Wed, 09 Mar 2022 07:46:56 +0200

Hive window function Over partition by

-Catalogue 1. Aggregate function + over2. partition by clause3. order by clause4. ★ window clause (included) - predicting: forward - FOLLOWING: backward - CURRENT ROW: CURRENT ROW - UNBOUNDED: starting point5. ★ sequence function in window function: including NTILE(n), row_number,rank,dense_rank   brief introduction The hive function in this ...

Added by BigTime on Tue, 08 Mar 2022 23:46:16 +0200

Graphic big data | Spark machine learning - workflow and Feature Engineering

Author: Han Xinzi@ShowMeAI Tutorial address: http://www.showmeai.tech/tutorials/84 Article address: http://www.showmeai.tech/article-detail/180 Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the source 1.Spark machine learning workflow 1) Spark mllib and ml Spark also has MLlib/ML for big d ...

Added by nunomira on Tue, 08 Mar 2022 18:14:48 +0200

Graphic big data | comprehensive case - mining music album data using Spark analysis

Author: Han Xinzi@ShowMeAITutorial address: http://www.showmeai.tech/tutorials/84Article address: http://www.showmeai.tech/article-detail/178Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the sourceintroductionThis is one of the most widely used cases of video and audio data processing of HDFS, ...

Added by Spoiler on Tue, 08 Mar 2022 17:26:31 +0200

Open source vector database -- milvus

Milvus is an open source vector similarity search engine, which supports the addition, deletion and modification of TB level vectors and near real-time query. It has the characteristics of high flexibility, stability, reliability and high-speed query. Milvus integrates widely used vector index libraries such as Faiss, NMSLIB and Annoy, and prov ...

Added by dibyendrah on Tue, 08 Mar 2022 16:49:49 +0200

Data synchronization between Clickhouse and Kafka

Author: Lemon Nan Original address: https://mp.weixin.qq.com/s/SUUHF9R_FKg-3vq7Q3cwBQ The original text and address shall be indicated introduce Clickhouse itself is an analytical database, which provides many synchronization schemes with other components. This paper will take Kafka as the data source to introduce how to synchronize Kaf ...

Added by muppet on Tue, 08 Mar 2022 16:31:27 +0200

Illustrating big data covid-19 case analysis of new crown pneumonia epidemic data using spark

Author: Han Xinzi@ShowMeAITutorial address: http://www.showmeai.tech/tutorials/84Article address: http://www.showmeai.tech/article-detail/176Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the sourceintroduction2020, since covid-19 has changed the world and affects everyone's life, this case comb ...

Added by subwayman on Tue, 08 Mar 2022 16:24:06 +0200