Hive SQL syntax summary
I've been doing hive related work these days. Fortunately, I learned a little before and got started very quickly. Now I'm free, let's systematically review the syntax of hive sql again
preface
Hive is an application tool based on data warehouse. It is used to process structured data in Hadoop. It is based on Hadoop and operates the data th ...
Added by napier_matt on Sun, 26 Sep 2021 03:33:07 +0300
KAFKA Foundation: Kafka API Producer API/Consumer API
This article is about Learning Guide for Big Data Specialists from Zero (Full Upgrade) Kafka: Partial supplement.
1 Producer API
1.1 Message Sending Process
Kafka's roducer sends messages asynchronously, involving two threads, the main thread and the Ender thread, and a thread-sharing variable, RecordAccumulator.
The main thread sends mes ...
Added by jtapoling on Wed, 22 Sep 2021 22:11:25 +0300
Big data - Python data analysis 2 (numpy module)
Catalog
Preface
Create a matrix (using ndarray objects)
Get the number of rows and columns of a matrix (in two dimensions)
Interception of Matrix
Intercept by row and column
Conditional interception
Combination of matrices
Create Matrix by Function
arange
linspace
logspace
ones,zeros,eye,empty
fromstring
fromfunction
Operations ...
Added by DarkArchon on Tue, 21 Sep 2021 00:49:46 +0300
Comparison of random update and insert performance of mysql under different database connection pools (DBCP,C3P0,Druid,Hikari)
The second part tests insert and update:
1 Environmental preparation
Two scenarios, Insert and Update, are prepared respectively. For the Update scenario, two scenarios are also prepared: Update through index and Update without index.
1.1 Update
The code is as follows:
package com.dhb.gts.javacourse.week6.mysqltest;
import com.dhb.gts.jav ...
Added by bocasz on Mon, 20 Sep 2021 22:16:23 +0300
Database notes (basic operation)
Database notes
Database foundation
1. Start MySql service on the terminal:
net start mysql;
2. Connect to MySQL: (add one, not - proot; oh)
mysql -h localhost -p 3306 -u root -proot (h Database links, p Database port number, u Database user name -p Database password, p (no space between and password)
3. View database:
`show databases; ...
Added by dannynosleeves on Mon, 20 Sep 2021 00:22:20 +0300
5 operation and maintenance enterprise -- mysql database
Introduction to mysql
(1) Introduction to MySQL
Mysql is a relational database. It is characterized by saving these data in different two-dimensional tables and putting these tables into the database, which can increase its reading speed.
(2) Application architecture of mysql
Single, suitable for small-scale applications Replicat ...
Added by ucbones on Sun, 19 Sep 2021 06:58:26 +0300
Dameng database is active and standby, with one active, two standby and one arbitration implementation step.
1, Environmental information
Internal communication IP Main library: Real_IP.1.5 Standby database: Real_IP.1.6 Standby database: Real_IP.1.7 Arbitration: Real_IP.1.8
Database media path: / home/dmdba/DMSoft/ Mount path: / home/dmdba/DMSoft/dminst Backup, archive, data file path / home/dmdba/{dmbak,dmarch,dmdata}
2, Configure the implemen ...
Added by mark s on Sat, 18 Sep 2021 13:42:27 +0300
Hive DML data operation (data import and export)
1, Data import
1. Load data into the table (load)
1.1 syntax
hive> load data [local] inpath '/opt/module/datas/student.txt' [overwrite] into table student [partition (partcol1=val1,...)];
(1) load data: indicates loading data (2) Local: indicates loading data from local to hive table; Otherwise, load data from HDFS to hive table (3) inp ...
Added by infyportalgroup on Sat, 18 Sep 2021 06:08:19 +0300
Vol.2 Mouse-based Gene Set Number Database Resources
Vol.2 Mouse-based Gene Set Number Database Resources
"Like the breeze running after the clouds looking at you from far to near"
About Author Yifan Fu Undergraduate, BUAA, Beijing
Major : BioinformaticsRecent focus : single-cell transcriptomics, metagenomics, multi-omics interactionContact : fan@buaa.edu.cn
0x00 written before
Ano ...
Added by auday1982 on Sun, 12 Sep 2021 19:23:48 +0300
Flume of Big Data Technology--An Introduction to Flume
Catalog
1. What is Flume?
1.1. Definition of flume
1.2, architecture of flume
2. Introduction to Flume
2.1, Download flume
2.2. Install flume
2.3. Small flume cases
2.3.1. Official Case - Monitoring Port
2.3.2, Real-time monitoring of individual appended files
2.3.3, Multiple files under Real-time Monitoring Directory
summary
1. ...
Added by uidzer0 on Sat, 11 Sep 2021 20:01:27 +0300