1.鐖彇baidu

baidudemo.py
#!/usr/bin/python
#-- coding:gb18030 --
import urllib2

response = urllib2.urlopen("http://www.baidu.com")
print response.read()

urllib2.urlopen
(url[, data[, timeout[, cafile[, capath[, cadefault[, context]]]]])
Open the URL url, which can be either a string or a Request
object.

2.鐖彇baidu

#!/usr/bin/python
#-*- coding:gb18030 -*-
import urllib
import urllib2
request = urllib2.Request("http://www.baidu.com")  
response = urllib2.urlopen(request)
print response.read()

class urllib2.Request
(url[, data][, headers][, origin_req_host][, unverifiable])

This class is an abstraction of a URL request.
url should be a string containing a valid URL.
data may be a string specifying additional data to send to the server, or None

3.妯℃嫙鐧诲綍

firefox鏌ョ湅鎻愪氦鐨勮〃鍗�/div>

#!/usr/bin/python
#-*- coding:gb18030 -*-
import requests
data={"userBean.loginName":"admin","userBean.loginPass":"52f9001b1e75069f3c8c8daac9961b8a"}      
s=requests.session()
#s.post(url='http://10.50.x.x/portal/login_init.action',data=data) #澶辫触    
s.post(url='http://10.50.x.x/admin/login_login.action',data=data)# 鎴愬姛 
r=s.get('http://10.50.x.x/admin/login_login.action')
print r.text

html淇℃伅

Python鐖櫕鏁欑▼鈥斺�旀ā鎷熺櫥褰晐Yiner in Python
Requests锛歅ython鐨凥TTP搴�/a>

4.妯℃嫙鐧诲綍

import urllib
import urllib2
values = {"userBean.loginName":"admin","userBean.loginPass":"52f9001b1e75069f3c8c8daac9961b8a"}
data = urllib.urlencode(values)
url = "http://10.50.x.x/admin/login_login.action"
request = urllib2.Request(url,data)
response = urllib2.urlopen(request)
print response.read()

urllib.urlencode(query[, doseq])锛�/strong>灏哾ict鎴栬�呭寘鍚袱涓厓绱犵殑鍏冪粍鍒楄〃杞崲鎴恥rl鍙傛暟銆備緥濡� 瀛楀吀{'name': 'dark-bull', 'age': 200}灏嗚杞崲涓�"name=dark-bull&age=200"

Python urllib妯″潡鐨刄RL缂栫爜瑙ｇ爜鍔熻兘

鎴愬姛鐖幓鐨刪tml淇℃伅

5.甯﹂獙璇佺爜鐨勬ā鎷熺櫥褰�

鎬濊矾:

a.鍏堟墦寮�鐧婚檰椤甸潰锛岃幏寰梒ookies銆�br> b.鍐嶈闂獙璇佺爜鐨勫湴鍧�銆傞獙璇佺爜鏄姩鎬佺殑锛屾瘡娆℃墦寮�閮戒笉涓�鏍枫��br> c.璇嗗埆楠岃瘉鐮併�傝繖閲屽氨闇�瑕佷綘澶勭悊銆佽瘑鍒垰鎵嶅緱鍒扮殑楠岃瘉鐮併�傝嚜宸卞幓鎵鹃獙璇佺爜(captcha)璇嗗埆搴擄紝python鍙互鐢� pytesser(杩欎釜搴撴槸璋冪敤PIL鏉ュ鐞嗚瘑鍒殑) 銆乷penc 涔嬬被鐨� 鎴栬�呭彲浠ヤ汉宸ヨ瘑鍒劧鍚庢墜鍔ㄨ緭鍏ラ獙璇佺爜銆�br> d.鏋勯�爌ost璇锋眰鏁版嵁(request data)鍜岃姹傚ご閮�(request head) 锛岀劧鍚� 灏嗘瀯閫犵殑璇锋眰 post缁欑綉绔�br> f.鑾峰彇鍝嶅簲(response)淇℃伅锛屽苟閫氳繃娴嬭瘯鏉ラ獙璇佺櫥闄嗘槸鍚︽垚鍔熴�傛垨鑰呯洿鎺ヨ烦杩嘺姝ラ锛�/p>
鍙傝��

鐢≒ython妯℃嫙鐧诲綍姝ｆ柟鏁欏姟绯荤粺骞舵姄鍙栧垵濮嬬綉椤电殑涓�浜涗釜浜虹瑪璁�/a>
python鐖櫕瀹炴垬涔嬫ā鎷熸鏂规暀鍔＄郴缁熺櫥褰曟煡璇㈡垚缁�/a>
python鍒疯鑴氭湰锛堟鏂规暀鍔＄郴缁燂級
鏁欏姟绯荤粺鐖櫕

key:

姣忔楠岃瘉鐮侀兘涓嶅悓

CheckCode.aspx

![error] VirtualBox VM, 浠婂ぉ at 涓嬪崍3.27.00.png](http://upload-images.jianshu.io/upload_images/1423035-bbee7f98f581abb0.png?imageMogr2/auto-orient/strip%7CimageView2/2/w/1240)
HTTP Error 302锛�br> 鎴愬姛搴旇鏄繑鍥�0

杩斿洖鐮侊細200

缂栫爜闂锛�/h4>
![] VirtualBox VM, 浠婂ぉ at 涓嬪崍3.58.35.png](http://upload-images.jianshu.io/upload_images/1423035-9c77238fb5522e2d.png?imageMogr2/auto-orient/strip%7CimageView2/2/w/1240)
RadioButtionList1:瀛︾敓
鍏堟妸鈥樺鐢熲�欎互utf8杩涜瑙ｇ爜锛岀劧鍚庣紪鐮佹垚gbk锛屾渶鍚庡啀杩涜url缂栫爜銆�br>

杈撳嚭锛�%D1%A7%C9%FA

姝ｅ父鐧婚檰鐨勮繃绋�/div>

鍏圥ost 璁块棶default3.aspx
鐒跺悗鍐峠et璁块棶xsmainfs.aspx锛焫h=xxxx
杩橀渶瑕佸啀璁块棶 xstop.aspx鍜寈sleft.aspx

post鏁版嵁鍒癲efault3.aspx鍚庝細閲嶅畾鍚戝埌/xsmainfs.aspx?xh=xx
post鏁版嵁鍒癲efault3.aspx鍚庝細杩斿洖302鐘舵�佺爜
鍚屾牱鍘昏闂畑smainfs.aspx鐨勬椂鍊欎篃浼氳繑鍥�2鐘舵�佺爜锛屾甯告儏鍐典笅搴旇鏄�0

鎶撳寘瑙傚療锛�/p>

post杩囧幓鐨勬暟鎹�/div>

锟界涓�娆¤繑鍥炰俊鎭�/div>

get璁块棶xsmainfs.aspx锛屽甫cookie

firefox debug

瀵规瘮锛屽氨connection涓嶅悓

xsmainfs杩斿洖302

302鏄粈涔堬紵

302閲嶅畾鍚戝張绉颁箣涓�2浠ｈ〃鏆傛椂鎬ц浆绉�(Temporarily Moved )锛岃嫳鏂囧悕绉帮細302 redirect銆� 涔熻璁や负鏄殏鏃堕噸瀹氬悜锛坱emporary redirect锛夛紝涓�鏉″缃戠珯娴忚鍣ㄧ殑鎸囦护鏉ユ樉绀烘祻瑙堝櫒琚 姹傛樉绀虹殑涓嶅悓鐨刄RL锛屽綋涓�涓綉椤电粡鍘嗚繃鐭湡鐨刄RL鐨勫彉鍖栨椂浣跨敤銆備竴涓殏鏃堕噸瀹氬悜鏄竴绉嶆湇鍔″櫒绔殑閲嶅畾鍚戯紝鑳藉琚�a href="https://link.jianshu.com?t=http://baike.baidu.com/view/2755932.htm" target="_blank" rel="nofollow">鎼滅储寮曟搸铚樿洓姝ｇ‘鍦板鐞嗐��/p>

涓轰粈涔堣繑鍥�2鍛紵

302涓嶆槸閿欒, 鏄痟ttp code. 鍐峢eader涓�, 浼氭湁Location: http://url.com, 鍛婅瘔娴忚鍣�, 涓嬩竴姝ョ殑鍦板潃, 娴忚鍣ㄦ娴嬪埌鍚�, 璺宠浆鍒版柊鍦板潃http//url.com.

搴旇瑕佽繑鍥�0鎵嶅

妯℃嫙鐧婚檰鎴愬姛锛�/h1>

杩斿洖200

杩斿洖200

鎺ヤ笅绫昏鑾峰彇涓汉淇℃伅鐨勬暟鎹�/p>

get鏂瑰紡锛�br> xsxx.aspx?xh=xx&xh1=xxx

鑾峰彇缃戦〉

姝ｅ垯琛ㄨ揪寮忔彁鍙栨暟鎹�br> 14055301xx
濮撳悕
锟藉嚭鐢熸棩鏈�
鎬у埆
鍏ュ鏃ユ湡
锟芥皯鏃�
涓撲笟鍚嶇О
涓撲笟鏂瑰悜
瀛﹂櫌鍚嶇О 鐝骇鍚嶇О
锟借韩浠借瘉鍙� 锟藉勾绾� 鑰冪敓鍙�
瀛﹀埗
鐢熸簮鎵�鍦ㄥ湴
鏀挎不闈㈣矊
瀛︾睄鐘舵��

鐩爣锛�/h1>
1.妯″潡鍖�br> 2.瀛樺叆鏁版嵁搴�br> 3.鑷姩鍖栬瘑鍒獙璇佺爜

google:python 姝ｆ柟鏁欏姟绯荤粺
涓�鍫嗐�傘�傘��br>

銆愭�荤粨銆慞ython 2.x涓父瑙佸瓧绗︾紪鐮佸拰瑙ｇ爜鏂归潰鐨勯敊璇強鍏惰В鍐冲姙娉�/a>

302锛氳姹傚埌鐨勮祫婧愬湪涓�涓笉鍚岀殑URL澶勪复鏃朵繚瀛� 澶勭悊鏂瑰紡锛氶噸瀹氬悜鍒颁复鏃剁殑URL

HTTPError鏄疷RLError鐨勫瓙绫伙紝鍦ㄤ綘鍒╃敤urlopen鏂规硶鍙戝嚭涓�涓姹傛椂锛屾湇鍔″櫒涓婇兘浼氬搴斾竴涓簲绛斿璞esponse锛屽叾涓畠鍖呭惈涓�涓暟瀛椻�濈姸鎬佺爜鈥濄�備妇涓緥瀛愶紝鍋囧response鏄竴涓�濋噸瀹氬悜鈥濓紝闇�瀹氫綅鍒板埆鐨勫湴鍧�鑾峰彇鏂囨。锛寀rllib2灏嗗姝よ繘琛屽鐞嗐��br> 鍏朵粬涓嶈兘澶勭悊鐨勶紝urlopen浼氫骇鐢熶竴涓狧TTPError锛屽搴旂浉搴旂殑鐘舵�佸悧锛孒TTP鐘舵�佺爜琛ㄧずHTTP鍗忚鎵�杩斿洖鐨勫搷搴旂殑鐘舵�併�備笅闈㈠皢鐘舵�佺爜褰掔粨濡備笅锛�/p>

杩橀渶瑕佸湪浠ｇ爜閲岄潰娣诲姞璁块棶xstop.aspx锛堝甫header鍜宑ookie锛�br> 浠ョ‘瀹氭槸鍚︾湡姝ｆā鎷熺櫥闄嗘垚鍔�/p>

urllib2.Request()

urllib2鐢ㄤ竴涓猂equest瀵硅薄鏉ユ槧灏勪綘鎻愬嚭鐨凥TTP璇锋眰,鍦ㄥ畠鏈�绠�鍗曠殑浣跨敤褰㈠紡涓綘灏嗙敤浣犺璇锋眰鐨勫湴鍧�鍒涘缓涓�涓猂equest瀵硅薄锛岄�氳繃璋冪敤urlopen骞朵紶鍏equest瀵硅薄锛屽皢杩斿洖涓�涓浉鍏宠姹俽esponse瀵硅薄锛岃繖涓簲绛斿璞″鍚屼竴涓枃浠跺璞★紝鎵�浠ヤ綘鍙互鍦≧esponse涓皟鐢�.read()銆�/p>

urllib2.build_opener()

鍚屾牱锛屽彲浠ヤ娇鐢╞uild_opener锛岃繖鏄竴涓洿鍔犳柟渚跨殑鍑芥暟锛岀敤鏉ュ垱寤簅pener瀵硅薄锛屼粬鍙渶瑕佷竴娆″嚱鏁拌皟鐢ㄣ��br> build_opener榛樿娣诲姞鍑犱釜澶勭悊鍣紝浣嗘彁渚涘揩鎹风殑鏂规硶鏉ユ坊鍔犳垨鏇存柊榛樿澶勭悊鍣ㄣ��br> 鍏朵粬鐨勫鐞嗗櫒handlers浣犳垨璁镐細甯屾湜澶勭悊浠ｇ悊锛岄獙璇侊紝鍜屽叾浠栧父鐢ㄤ絾鏈夌偣鐗规畩鐨勬儏鍐点��br> install_opener 鐢ㄦ潵鍒涘缓锛堝叏灞�锛夐粯璁pener銆傝繖涓〃绀鸿皟鐢╱rlopen灏嗕娇鐢ㄤ綘瀹夎鐨刼pener銆�br> Opener瀵硅薄鏈変竴涓猳pen鏂规硶銆�/p>

Python:urllib 鍜寀rllib2涔嬮棿鐨勫尯鍒�/a>
cookielib鍜寀rllib2妯″潡鐩哥粨鍚堟ā鎷熺綉绔欑櫥褰�/a>