▶️ ARTH — Task 7 💻

Task Description 📄

🌀 7.1: Elasticity Task — PART : 1

🔅Integrating LVM with Hadoop and providing Elasticity to DataNode Storage

1.INTEGRATING LVM WITH HADOOP

#MAIN STEP : CREATE A HADOOP CLUSTER

STEP:1:In DataNode : Add 2 hard disk

[disk name:1:/dev/sdb ; disk name:2:/dev/sdc]

STEP:2:Create physical volume (PV) for both hard disk.

pvcreate <disk name 1> <disk name 2>

To check : pvdisplay <disk name 1> <disk name 2>

STEP:3:Create volume group for both physical volume.

vgcreate <vg name> <disk name 1> <disk name 2>

To see : vgdisplay <vg name>

STEP:4:Create logical volume from volume group.

lvcreate — size <size> — name <lv name> <vg name>

[Size-that you want to contribute to namenode]

To see : lvdisplay <vg name>/<lv name>

STEP:5:Format the partition.

mkfs.ext4 /dev/<vg name>/<lv name>

STEP:6:Mount the partition (on data node folder [/dn]).

mount /dev/<vg name>/<lv name> /dn

STEP:7:Start datanode service.

CHECK : hadoop dfsadmin -report

2.PROVIDING ELASTICITY TO DATA NODE STORAGE

A.FOR EXPANSION:

1. Extension: lvextend — size +<size> /dev/<vg name>/<lv name>

2. Formatting: resize2fs /dev/<vg name>/<lv name>

To check : hadoof dfsadmin -report

B.FOR REDUCTION:

lvreduce -L <size> /dev/<vg name>/<lv name>

To check :

COMPLETED!!!