HDFS - operation and maintenance

1, Add node Operating system configuration: ① host name, network, firewall, ssh configuration ssh-keygen -t rsa At the same time, the auth*-keys file of ssh of any node in the cluster can be distributed to the latest node Add the domain name mapping of this node in the / etc/hosts file of all nodes Copy the configuration file of namenode to ...

Added by Rayman3.tk on Wed, 06 May 2020 02:22:05 +0300

Installation and introduction of hadoop

1 big data 1.1 big data concept big data, IT industry term refers to a collection of data that cannot be captured, managed and processed within a certain period of time with conventional software tools, It is a mass, high growth rate and diversified information asset that needs new processing mode t ...

Added by blackbeard on Thu, 16 Jan 2020 17:20:28 +0200

Hadoop Series: Building Hadoop High Availability Cluster Based on ZooKeeper

Introduction to High Availability High Availability of Hadoop can be divided into HDFS high availability and YARN high availability. Their implementation is basically similar, but HDFS NameNode requires much higher data storage and consistency than YARN Resource Manger, so its implementation is more complex. So let's explain the following: 1.1 ...

Added by enterume on Tue, 17 Sep 2019 16:53:49 +0300