浠庣綉涓婃姄浜嗕竴浜涘瓧鑺傛祦锛屾兂鎵撳嵃鍑烘潵缁撴灉鍙戠敓浜嗕竴涓嬮敊璇細
UnicodeEncodeError: 'gbk' codec can't encode character '\xbb' in position 8530: illegal multibyte sequence
浠ｇ爜
importurllib.request
res=urllib.request.urlopen('http://www.baidu.com')
htmlBytes=res.read()print(htmlBytes.decode('utf-8'))
閿欒淇℃伅璁╀汉寰堝洶鎯戯紝涓轰粈涔堢敤鐨勬槸'utf-8'瑙ｇ爜锛岄敊璇俊鎭嵈鎻愮ず'gbk'閿欒鍛紵
涓嶄粎濡傛锛屼粠鐧惧害棣栭〉鐨刪tml涓彂鐜颁互涓嬩唬鐮侊細
杩欒鏄庣綉椤电殑纭敤鐨勬槸utf-8锛屼负浠�涔堜細鍑虹幇Error鍛紵
鍦╬ython3閲岋紝鏈夊嚑鐐瑰叧浜庣紪鐮佺殑甯歌瘑
1.瀛楃灏辨槸unicode瀛楃锛屽瓧绗︿覆灏辨槸unicode瀛楃鏁扮粍
濡傛灉鐢ㄤ互涓嬩唬鐮佹祴璇曪紝
print('a'=='\u0061')
浼氬彂鐜扮粨鏋滀负True锛岃冻浠ヨ鏄庝袱鑰呯殑绛変环鍏崇郴銆�
2.str杞琤ytes鍙玡ncode锛宐ytes杞瑂tr鍙玠ecode锛屽涓婇潰鐨勪唬鐮佸氨鏄皢鎶撳埌鐨勫瓧鑺傛祦缁檇ecode鎴恥nicode鏁扮粍
鎴戞牴鎹笂闈㈢殑閿欒淇℃伅鍒嗘瀽浜嗗瓧鑺傛祦涓嚭鐜癨xbb鐨勫湴鏂癸紝鍙戠幇鏈変釜\xc2\xbb鐨勭壒娈婂瓧绗β伙紝鎴戞��鐤戞槸瀹冩棤娉曡瑙ｇ爜銆�
鐢ㄤ互涓嬩唬鐮佹祴璇曞悗
print(b'\xc2\xbb'.decode('utf-8'))
瀹冩灉鐒舵姤閿欎簡:UnicodeEncodeError: 'gbk' codec can't encode character '\xbb' in position 0: illegal multibyte sequence
涓婄綉鎵句簡涓媢tf-8缂栫爜琛紝鍙戠幇鐨勭‘鐗规畩瀛楃禄鐨剈tf-8褰㈠紡灏辨槸c2bb,unicode鏄�'\u00bb'锛屼负浠�涔堟棤娉曡В鐮佸憿銆傘�傘��
浠旂粏鐪嬬湅閿欒淇℃伅锛屽畠鎻愮ず'gbk'鏃犳硶encode锛屼絾鏄垜鐨勪唬鐮佹槸utf-8鏃犳硶decode锛屽帇鏍圭墰澶翠笉瀵归┈鍢达紝缁堜簬璁╂垜鎬�鐤戞槸print鍑芥暟鍑洪敊浜嗐�傘�備簬鏄珛鍗虫湁浜嗕互涓嬬殑娴嬭瘯
print('\u00bb')
缁撴灉鎶ラ敊浜嗭細UnicodeEncodeError: 'gbk' codec can't encode character '\xbb' in position 0: illegal multibyte sequence
鍘熸潵鏄痯rint()鍑芥暟鑷韩鏈夐檺鍒讹紝涓嶈兘瀹屽叏鎵撳嵃鎵�鏈夌殑unicode瀛楃銆�
鐭ラ亾鍘熷洜鍚庯紝google浜嗕竴涓嬭В鍐虫柟娉曪紝鍏跺疄print()鍑芥暟鐨勫眬闄愬氨鏄疨ython榛樿缂栫爜鐨勫眬闄愶紝鍥犱负绯荤粺鏄痺in7鐨勶紝python鐨勯粯璁ょ紪鐮佷笉鏄�'utf-8',鏀逛竴涓媝ython鐨勯粯璁ょ紪鐮佹垚'utf-8'灏辫浜�
importio
importsys
importurllib.request
sys.stdout= io.TextIOWrapper(sys.stdout.buffer,encoding='utf8')#鏀瑰彉鏍囧噯杈撳嚭鐨勯粯璁ょ紪鐮乺es=urllib.request.urlopen('http://www.baidu.com')
htmlBytes=res.read()print(htmlBytes.decode('utf-8'))
杩愯鍚庝笉鎶ラ敊浜嗭紝浣嗘槸灞呯劧鏈夊ソ澶氫贡鐮侊紙鑻辨枃鏄剧ず姝ｅ父锛屼腑鏂囧垯鏄剧ず涔辩爜锛夛紒锛佸張涓�闃垫姌鑵惧悗鍙戠幇鏄帶鍒跺彴鐨勯棶棰橈紝鍏蜂綋鏉ヨ灏辨槸鎴戝湪cmd涓嬭繍琛岃鑴氭湰浼氭湁涔辩爜锛岃�屽湪IDLE涓嬭繍琛屽嵈寰堟甯搞��
鐢辨鎴戞帹娴嬫槸cmd涓嶈兘寰堝ソ鍦板吋瀹箄tf8锛岃�孖DLE灏卞彲浠ワ紝鐢氳嚦鍦↖DLE涓嬭繍琛岋紝杩炩�滄敼鍙樻爣鍑嗚緭鍑虹殑榛樿缂栫爜鈥濋兘涓嶇敤锛屽洜涓哄畠榛樿灏辨槸utf8銆傚鏋滀竴瀹氳鍦╟md涓嬭繍琛岋紝閭ｅ氨鏀逛竴涓嬬紪鐮侊紝姣斿鎴戞崲鎴愨�済b18030鈥濓紝灏辫兘姝ｅ父鏄剧ず浜嗭細
sys.stdout = io.TextIOWrapper(sys.stdout.buffer,encoding='gb18030')#鏀瑰彉鏍囧噯杈撳嚭鐨勯粯璁ょ紪鐮�
鏈�鍚庯紝闄勪笂涓�浜涘父鐢ㄧ殑鍜屼腑鏂囨湁鍏崇殑缂栫爜鐨勫悕绉帮紝鍒嗗埆璧嬪�肩粰encoding锛屽氨鍙互鐪嬪埌涓嶅悓鐨勬晥鏋滀簡锛�
缂栫爜鍚嶇О鐢ㄩ��
utf8鎵�鏈夎瑷�
gbk绠�浣撲腑鏂�
gb2312绠�浣撲腑鏂�
gb18030绠�浣撲腑鏂�
big5绻佷綋涓枃
big5hkscs绻佷綋涓枃
http://www.cnblogs.com/feng18/p/5646925.html