hadoop - HDFS capacity mismatch -
i'm doing tests on hadoop , hdfs full after tests. deleted lot of test files recursively released space not as expected.
running hadoop fs -du -s /
command, reports 876447242289. means 0.8 tb. in name node ui, reports 12 tb still in used.
configured capacity : 19.89 tb dfs used : 12.15 tb non dfs used : 801.66 gb dfs remaining : 6.95 tb dfs used% : 61.11 % dfs remaining% : 34.96 % block pool used : 12.15 tb block pool used% : 61.11 %
i ran `df -h. in each data node , found same result name node ui.
i checked .trash
folder , nothing there. looks many files removed name node, still not deleted in data node. can on this?
i found space released gradually. after 8 hours, spaces held deleted files released.
Comments
Post a Comment