hadoop_ Hdfs07 hdfsha cluster configuration & ZK cluster configuration & yarnHA configuration

hadoop_ Hdfs07 hdfsha cluster configuration & ZK cluster configuration & yarnha configuration Note: notes (1) Cluster planning Hadoop102Hadoop03Hadoop04ZKZKZKJournaleNodeJournaleNodeJournaleNodeNameNodeNameNodeDataNodeDataNodeDataNodeResourceManagerResourceManagerNodeManagerNodeManagerNodeManager (2) Configuring Zookeeper clusters ...

Added by DarkArchon on Sun, 26 Dec 2021 06:36:22 +0200

Logstash: use logstash to analyze Service API data

I remember in the previous article“ Logstash: API analysis using ELK stack ”Use Logstash to analyze the API of some indicators. In today's exercise, I will show how to use Logstash to analyze the service APIs of some log classes. We know that in many cases, we can quickly use some scripts to analyze the data of some service APIs. Th ...

Added by kostasls on Sat, 25 Dec 2021 20:54:09 +0200

Are you still using group by? Experts are using grouping sets

Let's take a look at a problem in actual generation: There is a user access record table, which records the user's access under different channels, operating systems and versions, As follows: create table test.test10 as select '10001' as uid,'xiaomi' as qid,'android' as os,'1.2.2' as ver union all select '10002' as uid,'xiaomi' as qid,'andro ...

Added by jpowermacg4 on Sat, 25 Dec 2021 18:29:07 +0200

[learning notes] Task05: window functions -- Tianchi Longzhu plan SQL training camp

Task05: window functions, etc. - Tianchi Longzhu program SQL training camp Original tutorial link Recommended reference books: SQL basics tutorial Window function Window functions are also called OLAP functions. OLAP is short for online analytical processing, which means real-time analysis and processing of database data. Conventional ...

Added by Mahfouz on Sat, 25 Dec 2021 17:38:09 +0200

Detailed records of Apache Druid stand-alone environment construction and basic use

Apache Druid Apache Druid is a real-time analytical database designed for rapid query analysis ("OLAP" queries) on large data sets. Druid is most often used as a database to support application scenarios of real-time ingestion, high-performance query and high stable operation. At the same time, Druid is also usually used to he ...

Added by Brandon Jaeger on Sat, 25 Dec 2021 15:34:58 +0200

How difficult is gesture event acquisition?

1, Foreword Gesture event collection is the core function of iOS click event collection. The implementation idea of gesture event collection is not complex, but there are many difficulties. This paper gives solutions to these difficulties one by one. Let's take a look at how to collect gesture events in iOS. 2, Gesture introduction Appl ...

Added by stubarny on Sat, 25 Dec 2021 05:49:39 +0200

impala, hive, phoenix, hbase mapping test

**Requirements: you want to maintain two wide tables on phoenix, one for ad hoc query, one for one day's data and one for history. The characteristic of wide table is that it is composed of multiple tables, but the arrival time of each table is inconsistent. Some tables arrive first, and some tables may arrive every other day. What you want to ...

Added by crashmaster on Sat, 25 Dec 2021 03:58:04 +0200

Android SDK startup and exit scheme evolution | data collection

1, Foreword In operation analysis, DAU (Daily Active User), UV (Unique Visitor) and user usage duration are the three most common indicators. For an App, the meanings of the three indicators are as follows: DAU: number of daily active users; UV: independent visitors; User usage duration: App usage duration. According to the above descri ...

Added by Derokorian on Fri, 24 Dec 2021 20:33:37 +0200

Spark sql learning notes -- DataFrame, Dataset and sql parsing principles

catalogue 1, SparkSession, DataFrame and Dataset 2, Spark Sql parsing 1. Overall overview 2. sql syntax parsing key objects 3, Spark LogicalPlan 1. Overall overview 2. LogicalPlan class structure system​ 3. Generated by analyzed logicalplan 1, SparkSession, DataFrame and Dataset 1. To use the sparksql function, you need to create a ...

Added by cute_girl on Fri, 24 Dec 2021 03:44:53 +0200

Flink: Flink getting started and running architecture

Flink (I): introduction to Flink installation and running architecture What is flink? Apache Flink is a memory stream based computing engine born in December 2014. Apache Flink is a framework and distributed processing engine for stateful computing on unbounded and bounded data streams. Flink is designed to run in all common cluster envi ...

Added by hunna03 on Thu, 23 Dec 2021 12:22:09 +0200