Hadoop权威指南NCDC数据获取

$ vi getNcdcBigData.sh

# !/bin/bash
for i in {1901..2014}
do
     cd /home/xxxx/hapood/ncdc
    wget --execute robots=off -r -np -nH --cut-dirs=4 -R index.html* ftp://ftp.ncdc.noaa.gov/pub/data/gsod/$i/
done

$ chmod +x getNcdcBigData.sh
$ ./getNcdcBigData.sh

参考:
【NCDC数据】获取 hadoop权威指南3中的NCDC数据