Thursday, December 20, 2012

Understanding HDFS quotas and Hadoop fs and fsck tools @ Michael G. Noll

Understanding HDFS quotas and Hadoop fs and fsck tools @ Michael G. Noll: "hadoop fsck /path/to/directory
Total size: 16565944775310 B <=== see here
Total dirs: 3922
Total files: 418464
Total blocks (validated): 502705 (avg. block size 32953610 B)
Minimally replicated blocks: 502705 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 3.0
Corrupt blocks: 0
Missing replicas: 0 (0.0 %)
Number of data-nodes: 18
Number of racks: 1
FSCK ended at Thu Oct 20 20:49:59 CET 2011 in 7516 milliseconds

The filesystem under path '/path/to/directory' is HEALTHY

$ hadoop fs -dus /path/to/directory
hdfs://master:54310/path/to/directory 16565944775310 <=== see here"

'via Blog this'