hadoop_ Hdfs07 hdfsha cluster configuration & ZK cluster configuration & yarnHA configuration
hadoop_ Hdfs07 hdfsha cluster configuration & ZK cluster configuration & yarnha configuration
Note: notes
(1) Cluster planning
Hadoop102Hadoop03Hadoop04ZKZKZKJournaleNodeJournaleNodeJournaleNodeNameNodeNameNodeDataNodeDataNodeDataNodeResourceManagerResourceManagerNodeManagerNodeManagerNodeManager
(2) Configuring Zookeeper clusters
...
Added by DarkArchon on Sun, 26 Dec 2021 06:36:22 +0200
Logstash: use logstash to analyze Service API data
I remember in the previous article“ Logstash: API analysis using ELK stack ”Use Logstash to analyze the API of some indicators. In today's exercise, I will show how to use Logstash to analyze the service APIs of some log classes. We know that in many cases, we can quickly use some scripts to analyze the data of some service APIs. Th ...
Added by kostasls on Sat, 25 Dec 2021 20:54:09 +0200
Are you still using group by? Experts are using grouping sets
Let's take a look at a problem in actual generation:
There is a user access record table, which records the user's access under different channels, operating systems and versions, As follows:
create table test.test10 as
select '10001' as uid,'xiaomi' as qid,'android' as os,'1.2.2' as ver
union all
select '10002' as uid,'xiaomi' as qid,'andro ...
Added by jpowermacg4 on Sat, 25 Dec 2021 18:29:07 +0200
[learning notes] Task05: window functions -- Tianchi Longzhu plan SQL training camp
Task05: window functions, etc. - Tianchi Longzhu program SQL training camp
Original tutorial link
Recommended reference books: SQL basics tutorial
Window function
Window functions are also called OLAP functions. OLAP is short for online analytical processing, which means real-time analysis and processing of database data.
Conventional ...
Added by Mahfouz on Sat, 25 Dec 2021 17:38:09 +0200
Detailed records of Apache Druid stand-alone environment construction and basic use
Apache Druid
Apache Druid is a real-time analytical database designed for rapid query analysis ("OLAP" queries) on large data sets. Druid is most often used as a database to support application scenarios of real-time ingestion, high-performance query and high stable operation. At the same time, Druid is also usually used to he ...
Added by Brandon Jaeger on Sat, 25 Dec 2021 15:34:58 +0200
How difficult is gesture event acquisition?
1, Foreword
Gesture event collection is the core function of iOS click event collection. The implementation idea of gesture event collection is not complex, but there are many difficulties. This paper gives solutions to these difficulties one by one.
Let's take a look at how to collect gesture events in iOS.
2, Gesture introduction
Appl ...
Added by stubarny on Sat, 25 Dec 2021 05:49:39 +0200
impala, hive, phoenix, hbase mapping test
**Requirements: you want to maintain two wide tables on phoenix, one for ad hoc query, one for one day's data and one for history. The characteristic of wide table is that it is composed of multiple tables, but the arrival time of each table is inconsistent. Some tables arrive first, and some tables may arrive every other day. What you want to ...
Added by crashmaster on Sat, 25 Dec 2021 03:58:04 +0200
Android SDK startup and exit scheme evolution | data collection
1, Foreword
In operation analysis, DAU (Daily Active User), UV (Unique Visitor) and user usage duration are the three most common indicators. For an App, the meanings of the three indicators are as follows:
DAU: number of daily active users; UV: independent visitors; User usage duration: App usage duration.
According to the above descri ...
Added by Derokorian on Fri, 24 Dec 2021 20:33:37 +0200
Spark sql learning notes -- DataFrame, Dataset and sql parsing principles
catalogue
1, SparkSession, DataFrame and Dataset
2, Spark Sql parsing
1. Overall overview
2. sql syntax parsing key objects
3, Spark LogicalPlan
1. Overall overview
2. LogicalPlan class structure system
3. Generated by analyzed logicalplan
1, SparkSession, DataFrame and Dataset
1. To use the sparksql function, you need to create a ...
Added by cute_girl on Fri, 24 Dec 2021 03:44:53 +0200
Flink: Flink getting started and running architecture
Flink (I): introduction to Flink installation and running architecture
What is flink?
Apache Flink is a memory stream based computing engine born in December 2014.
Apache Flink is a framework and distributed processing engine for stateful computing on unbounded and bounded data streams. Flink is designed to run in all common cluster envi ...
Added by hunna03 on Thu, 23 Dec 2021 12:22:09 +0200