WARNING : There are about 34 missing blocks. Please check the log or run fsck.
'jifeng01:9000'
| Started: | Sat Sep 06 22:41:47 CST 2014 |
| Version: | 1.2.1, 1503152 |
| Compiled: | Mon Jul 22 15:23:09 PDT 2013 by mattf |
Browse the filesystem
jifeng01:9000 Logs
Go back to DFS home
Reported Corrupt Files
blk_-6457274919514896544 /home/jifeng/out/part-m-00004blk_-5584297838940778022 /user/jifeng/output/random-seeds/part-randomSeed
blk_-5243301279492742263 /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929
blk_-3888018766322651506 /home/jifeng/out/part-m-00009
blk_-2853897503049953015 /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml
blk_-2825733319432881440 /home/jifeng/pids/part-m-00007.seq
blk_-2049677542258916799 /user/jifeng/testdata/synthetic_control.data
blk_-1403735329502570594 /user/jifeng/hbase/scores/.tableinfo.0000000001
blk_-1329383103204158484 /user/jifeng/output/clusters-2/_policy
blk_-1092299033788448642 /user/jifeng/hbase/-ROOT-/70236052/.regioninfo
blk_-959108783924676624 /user/jifeng/output/clusters-4/_policy
blk_-824171596733300207 /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml
blk_-703416978362433992 /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat
blk_-68589977821710110 /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001
blk_109205275959958993 /user/jifeng/output/_policy
blk_575730840927164662 /user/jifeng/hbase/hbase.id
blk_928839098900765633 /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob
blk_2369857512018989453 /user/jifeng/output/clusters-3/part-r-00000
blk_3764002349176068586 /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml
blk_3852612576123523390 /home/jifeng/pids/part-m-00003.seq
blk_3910032104823961563 /user/jifeng/output/clusters-0/part-00003
blk_4314247290342042317 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml
blk_5877660712985883910 /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75
blk_5976038500197801228 /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3
blk_7396752195048257419 /user/jifeng/output/clusters-7/part-r-00000
blk_7422539300806584926 /user/jifeng/output/clusters-6/_policy
blk_7768269153299453904 /home/jifeng/pids/part-m-00000.seq
blk_7907833205724261986 /user/jifeng/output/clusters-0/part-00004
blk_8225354003048181368 /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml
blk_8644617765668849324 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat
blk_8725357001115122394 /home/jifeng/out/part-m-00001
blk_9080037511646150766 /user/jifeng/output/clusters-8/part-r-00000
blk_9171939222431302382 /home/jifeng/pids/part-m-00002.seq
Total: At least 33 corrupt file(s)
检查损坏的hdfs文件列表 使用命令可以打印出损坏的文件列表: hadoop fsck
没有冗余备份,只能删除损坏的文件,使用命令: hadoop fsck --delete
[jifeng@jifeng01 hbase-0.94.21]$ hadoop fsck --delete Warning: $HADOOP_HOME is deprecated. FSCK started by jifeng from /10.5.4.54 for path / at Sat Sep 06 23:05:11 CST 2014 . /home/jifeng/hadoop/tmp/mapred/staging/jifeng/.staging/job_201408132307_0012/job.jar: Under replicated blk_-4953605809636462967_1091. Target Replicas is 10 but found 3 replica(s). . /home/jifeng/hadoop/tmp/mapred/staging/jifeng/.staging/job_201408132307_0015/job.jar: Under replicated blk_-3894987090632193800_1108. Target Replicas is 10 but found 3 replica(s). ... /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob: CORRUPT block blk_928839098900765633 /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob: MISSING 1 blocks of total size 44200 B.. /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml: CORRUPT block blk_-2853897503049953015 /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml: MISSING 1 blocks of total size 56963 B... /home/jifeng/out/part-m-00001: CORRUPT block blk_8725357001115122394 /home/jifeng/out/part-m-00001: MISSING 1 blocks of total size 8626 B.... /home/jifeng/out/part-m-00004: CORRUPT block blk_-6457274919514896544 /home/jifeng/out/part-m-00004: MISSING 1 blocks of total size 8440 B...... /home/jifeng/out/part-m-00009: CORRUPT block blk_-3888018766322651506 /home/jifeng/out/part-m-00009: MISSING 1 blocks of total size 2287 B.... /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml: CORRUPT block blk_-824171596733300207 /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml: MISSING 1 blocks of total size 56968 B.. /home/jifeng/pids/part-m-00000.seq: CORRUPT block blk_7768269153299453904 /home/jifeng/pids/part-m-00000.seq: MISSING 1 blocks of total size 7499 B... /home/jifeng/pids/part-m-00002.seq: CORRUPT block blk_9171939222431302382 /home/jifeng/pids/part-m-00002.seq: MISSING 1 blocks of total size 9319 B.. /home/jifeng/pids/part-m-00003.seq: CORRUPT block blk_3852612576123523390 /home/jifeng/pids/part-m-00003.seq: MISSING 1 blocks of total size 9138 B..... /home/jifeng/pids/part-m-00007.seq: CORRUPT block blk_-2825733319432881440 /home/jifeng/pids/part-m-00007.seq: MISSING 1 blocks of total size 86 B.............. /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001: CORRUPT block blk_-68589977821710110 /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001: MISSING 1 blocks of total size 728 B... /user/jifeng/hbase/-ROOT-/70236052/.regioninfo: CORRUPT block blk_-1092299033788448642 /user/jifeng/hbase/-ROOT-/70236052/.regioninfo: MISSING 1 blocks of total size 109 B.. /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75: CORRUPT block blk_5877660712985883910 /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75: MISSING 1 blocks of total size 1067 B.... /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3: CORRUPT block blk_5976038500197801228 /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3: MISSING 1 blocks of total size 1473 B.. /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929: CORRUPT block blk_-5243301279492742263 /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929: MISSING 1 blocks of total size 134 B... /user/jifeng/hbase/hbase.id: CORRUPT block blk_575730840927164662 /user/jifeng/hbase/hbase.id: MISSING 1 blocks of total size 38 B....... /user/jifeng/hbase/scores/.tableinfo.0000000001: CORRUPT block blk_-1403735329502570594 /user/jifeng/hbase/scores/.tableinfo.0000000001: MISSING 1 blocks of total size 1273 B........................... /user/jifeng/output/_policy: CORRUPT block blk_109205275959958993 /user/jifeng/output/_policy: MISSING 1 blocks of total size 194 B.......... /user/jifeng/output/clusters-0/part-00003: CORRUPT block blk_3910032104823961563 /user/jifeng/output/clusters-0/part-00003: MISSING 1 blocks of total size 1891 B.. /user/jifeng/output/clusters-0/part-00004: CORRUPT block blk_7907833205724261986 /user/jifeng/output/clusters-0/part-00004: MISSING 1 blocks of total size 1891 B..... /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml: CORRUPT block blk_8225354003048181368 /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml: MISSING 1 blocks of total size 50269 B...... ...... /user/jifeng/output/clusters-2/_policy: CORRUPT block blk_-1329383103204158484 /user/jifeng/output/clusters-2/_policy: MISSING 1 blocks of total size 194 B.... /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat: CORRUPT block blk_8644617765668849324 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat: MISSING 1 blocks of total size 13899 B.. /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml: CORRUPT block blk_4314247290342042317 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml: MISSING 1 blocks of total size 50269 B... /user/jifeng/output/clusters-3/part-r-00000: CORRUPT block blk_2369857512018989453 /user/jifeng/output/clusters-3/part-r-00000: MISSING 1 blocks of total size 7581 B... /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat: CORRUPT block blk_-703416978362433992 /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat: MISSING 1 blocks of total size 13893 B... /user/jifeng/output/clusters-4/_policy: CORRUPT block blk_-959108783924676624 /user/jifeng/output/clusters-4/_policy: MISSING 1 blocks of total size 194 B........... /user/jifeng/output/clusters-6/_policy: CORRUPT block blk_7422539300806584926 /user/jifeng/output/clusters-6/_policy: MISSING 1 blocks of total size 194 B....... /user/jifeng/output/clusters-7/part-r-00000: CORRUPT block blk_7396752195048257419 /user/jifeng/output/clusters-7/part-r-00000: MISSING 1 blocks of total size 7581 B...... /user/jifeng/output/clusters-8/part-r-00000: CORRUPT block blk_9080037511646150766 /user/jifeng/output/clusters-8/part-r-00000: MISSING 1 blocks of total size 7581 B......... /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml: CORRUPT block blk_3764002349176068586 /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml: MISSING 1 blocks of total size 49204 B... /user/jifeng/output/random-seeds/part-randomSeed: CORRUPT block blk_-5584297838940778022 /user/jifeng/output/random-seeds/part-randomSeed: MISSING 1 blocks of total size 7750 B... /user/jifeng/testdata/synthetic_control.data: CORRUPT block blk_-2049677542258916799 /user/jifeng/testdata/synthetic_control.data: MISSING 1 blocks of total size 288374 B.Status: CORRUPT Total size: 1304321705 B Total dirs: 121 Total files: 149 Total blocks (validated): 143 (avg. block size 9121130 B) ******************************** CORRUPT FILES: 33 MISSING BLOCKS: 33 MISSING SIZE: 709307 B CORRUPT BLOCKS: 33 ******************************** Minimally replicated blocks: 110 (76.92308 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 2 (1.3986014 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 1 Average block replication: 0.8811189 Corrupt blocks: 33 Missing replicas: 14 (11.111111 %) Number of data-nodes: 3 Number of racks: 1 FSCK ended at Sat Sep 06 23:05:11 CST 2014 in 22 milliseconds The filesystem under path '/' is CORRUPT [jifeng@jifeng01 hbase-0.94.21]$