hadoop dfs的小技巧

在测试hadoop的dfs的各种命令的时候，突然发现dfs -rmr支持通配符操作（前提是要在hadoop的bin目录下执行）

补充点：ls cat也支持通配符的

 

例如执行ls后有如下文件

 

 [dikar@dikar ~]$ hadoop dfs -ls
 opts=  -Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20 . 2 /bin/../logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/dikar/Program/hadoop- 0.20 . 2 /bin/.. -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/dikar/Program/hadoop- 0.20 . 2 /bin/../lib/native/Linux-i386- 32  -Dhadoop.policy.file=hadoop-policy.xml
 class =org.apache.hadoop.fs.FsShell
 params=-ls
 Found 3  items
 -rw-r--r--   2  dikar supergroup         622   2011 - 03 - 05   16 : 55  /user/dikar/ta
 -rw-r--r--   2  dikar supergroup           9   2011 - 03 - 05   16 : 51  /user/dikar/test1
 -rw-r--r--   2  dikar supergroup          10   2011 - 03 - 05   16 : 51  /user/dikar/test2

 然后执行rmr test*

 

 [dikar@dikar bin]$ hadoop dfs -rmr test*
 opts=  -Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20 . 2 /bin/../logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/dikar/Program/hadoop- 0.20 . 2 /bin/.. -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/dikar/Program/hadoop- 0.20 . 2 /bin/../lib/native/Linux-i386- 32  -Dhadoop.policy.file=hadoop-policy.xml
 class =org.apache.hadoop.fs.FsShell
 params=-rmr test*
 Deleted hdfs://dikar:54310 /user/dikar/test1
 Deleted hdfs://dikar:54310 /user/dikar/test2

 在用ls 查看

 

 [dikar@dikar bin]$ hadoop dfs -ls
 opts=  -Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20 . 2 /bin/../logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/dikar/Program/hadoop- 0.20 . 2 /bin/.. -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/dikar/Program/hadoop- 0.20 . 2 /bin/../lib/native/Linux-i386- 32  -Dhadoop.policy.file=hadoop-policy.xml
 class =org.apache.hadoop.fs.FsShell
 params=-ls
 Found 1  items
 -rw-r--r--   2  dikar supergroup         622   2011 - 03 - 05   16 : 59  /user/dikar/ta

 更多信息请查看 java进阶网 http://www.javady.com