HDFS - operation and maintenance
1, Add node
Operating system configuration: ① host name, network, firewall, ssh configuration
ssh-keygen -t rsa
At the same time, the auth*-keys file of ssh of any node in the cluster can be distributed to the latest node
Add the domain name mapping of this node in the / etc/hosts file of all nodes
Copy the configuration file of namenode to ...
Added by Rayman3.tk on Wed, 06 May 2020 02:22:05 +0300
Installation and introduction of hadoop
1 big data
1.1 big data concept
big data,
IT industry term refers to a collection of data that cannot be captured, managed and processed within a certain period of time with conventional software tools,
It is a mass, high growth rate and diversified information asset that needs new processing mode t ...
Added by blackbeard on Thu, 16 Jan 2020 17:20:28 +0200
Hadoop Series: Building Hadoop High Availability Cluster Based on ZooKeeper
Introduction to High Availability
High Availability of Hadoop can be divided into HDFS high availability and YARN high availability. Their implementation is basically similar, but HDFS NameNode requires much higher data storage and consistency than YARN Resource Manger, so its implementation is more complex. So let's explain the following:
1.1 ...
Added by enterume on Tue, 17 Sep 2019 16:53:49 +0300