Cluster configuration:
2 namenodes(active and standby)
5 datanodes
2 edge nodes(dev and prod)
Hosts
host | OS | IP | rack | position |
r02edge | CentOS Linux release 7.8.2003 (Core) | 192.168.2.30 | 2 | 2 |
r01edge | CentOS Linux release 7.8.2003 (Core) | 192.168.2.22 | 2 | 5 |
datanode1 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.23 | 1 | 1 |
datanode2 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.24 | 2 | 1 |
datanode3 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.27 | 2 | 3 |
datanode4 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.28 | 1 | 3 |
datanode5 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.29 | 1 | 2 |
namenode1 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.25 | 1 | 4 |
namenode2 | CentOS Linux release 7.8.2003 (Core) | 192.168.2.26 | 2 | 4 |
OS: RHEL7 has been replaced by CentOS Linux release 7.8.2003 (Core) – no yum update is possible in RHEL 7 without subscription
Hardware diagram
Hardware setup
- DELL PowerEdge R710 and DELL PowerEdge R610
- RAM as per supported configuration
- Harddrives:
Namenodes: RAID1 for system, RAID0 for data(fsimage and edits)
Datanodes: RAID0
- Network adapters -4 each Adding bonding for multiple network adapters
Routers:
2 Netgear 24 port switches(1G),interconnected
(optional 1 optical 10G,connecting 2 netgear switches
Rack, power outlets, UPS, Ventilation.
Creating network cables of proper size.
Assembling and mounting the computers, connecting network
Labeling the computers with the system specifications and storing the inventory
Benchmark the disk speed
yum install hdparm
[root@datanode4 ~]#hdparm -Tt /dev/sdb
/dev/sdb:
Timing cached reads: 15404 MB in 1.99 seconds = 7738.06 MB/sec
Timing buffered disk reads: 1344 MB in 3.00 seconds = 447.97 MB/sec
[root@datanode4 ~]# hdparm -Tt /dev/sdc
/dev/sdc:
Timing cached reads: 14834 MB in 1.99 seconds = 7450.71 MB/sec
Timing buffered disk reads: 934 MB in 3.00 seconds = 311.31 MB/sec