Crawler Index Page

http://hi.baidu.com/cwyalpha/item/a0b1a4c345cfefbb0c0a7b53

Python 爬虫抓站 记录（虾米，百度，豆瓣，新浪微博）

 

http://www.crummy.com/software/BeautifulSoup/bs3/documentation.zh.htmlBeautiful Soup

http://wwwsearch.sourceforge.net/mechanize/mechanize

http://www.pythonclub.org/python-network-application/observer-spider用python爬虫抓站的一些技巧总结 zz

http://www.pythonclub.org/python-network-application/http-protocolHTTP

http://www.cnblogs.com/cheungjustin/archive/2012/01/05/2313511.htmlURLlib

http://www.cnblogs.com/cheungjustin/archive/2012/01/05/2313509.htmlURLlib

http://docs.python.org/library/urllib.htmlOFFICAL URLLIB

http://docs.python.org/library/urllib2.htmlOFFICAL URLLIB2

http://www.voidspace.org.uk/python/articles/urllib2.shtml#proxiesiron python urllib2