Big data project 1 (data preprocessing)
1, Understand what preprocessing is
Data preprocessing is a data mining technology. Its essence is to convert the original data into an understandable format or in line with our mining format.
2, Why preprocessing
In the real world, data is usually incomplete (lack of some interesting attribute values), inconsistent (including difference ...
Added by mjlogan on Tue, 18 Jan 2022 15:18:21 +0200
ORCH visual high availability cluster
1. Introduction to Orch
Orchestrator (orch): MySQL high availability and replication topology management tool written by go, which supports the adjustment of replication topology, automatic failover and manual master-slave switching. The back-end database uses MySQL or SQLite to store metadata, and provides a Web interface to display the topol ...
Added by ScottCFR on Tue, 18 Jan 2022 11:26:15 +0200
Postgresql gossip 05 - JSON and JSONB types in Postgresql
1, JSON and JSONB
Compared with other relational databases, Postgresql has a great advantage in that it has built-in many special data types, such as inet and MAC. The json and json types introduced in this paper are also two unique data types of Postgresql. In fact, their essence is to store data in jon format, However, the difference is that ...
Added by The Chancer on Tue, 18 Jan 2022 07:42:43 +0200
mysql self optimization - optimizing select statements
First of all, I want to briefly explain that this article is translated from
mysql manual , and through my integration, there are many text contents, but the actual gold content is relatively high,
I suggest you read it carefully,
There must be harvest.
1. GROUP BY optimization
The most common way to satisfy a GROUP BY clause is to scan t ...
Added by StormTheGates on Tue, 18 Jan 2022 01:34:11 +0200
SQL set operation
catalogue
Addition and subtraction of tables
What is set operation
Addition of tables -- UNION
Precautions for set operation
Set operation with duplicate rows - ALL option
Select the common part in the table - INTERSECT (intersection)
Recorded subtraction - Excel (difference set)
Join (join tables in columns)
What is connection
IN ...
Added by dave_2008 on Mon, 17 Jan 2022 13:23:46 +0200
Redis knowledge summary
Five data types
key creation
View all key s in the current library
keys *
Determine whether a key exists
exists key
View the type of key
type key
Delete key
del key
unlink key --Asynchronous deletion
Set the expiration time of the key
expire key 10
See how many seconds are left to expire
ttl key ---1 Means never ...
Added by emehrkay on Mon, 17 Jan 2022 10:12:17 +0200
Technology sharing | analysis of Prometheus+Grafana monitoring MySQL
The original content of GreatSQL community cannot be used without authorization. Please contact Xiaobian and indicate the source for reprint.brief introductionPrometheus is an open-source combination of monitoring & Alarm & time series database. Usually, Kubernetes will cooperate with Prometheus for monitoring. Because the image of Prom ...
Added by infusionstudios on Mon, 17 Jan 2022 09:19:53 +0200
Summary of primary use of dm8-diasql
Usage Summary of diasql
preface:
Last time, the DM8 database was built in linux, but it was not initialized. sql statements were tested and disql was used. This blog records the initialization under linux and summarizes how to use disql. For the installation of DM8, please refer to my previous blog:
Link: Installation of DM8 (win and lin ...
Added by Cornelia on Mon, 17 Jan 2022 07:09:26 +0200
Easy to understand index
*1 * ***** 0 * * * introduction
Why index?
In general application systems, the read-write ratio is about 10:1, and there are few performance problems in insert operations and general update operations. In the production environment, we encounter the most and most prone to problems, or some complex query operations. Therefore, the optimization ...
Added by gtanzer on Mon, 17 Jan 2022 00:03:03 +0200
java Transformation Road - Database
java Transformation Road - database (I)
Those who discipline themselves are enough to convince others, and small steps can reach thousands of miles.
As mobile developers, although they are familiar with java syntax, they are only the tip of the iceberg for back-end development. Self discipline is not a temporary brain fever. Ideas need to be ...
Added by davinci on Sun, 16 Jan 2022 22:29:26 +0200