网络爬虫-一键转换爬虫请求头headers(Fillder/各大浏览器适用)

程序员都是懒惰的~

这个是真理！

于是有了这个一键转换请求头的神器，平时厌烦了打单双引号，逗号的童鞋可以偷懒了，咱做爬虫的，也挺不容易的~

直接贴代码 -->(原理很简单,目前测试了fiddler和浏览器的请求头)

import json


def get_header(headers):
    hs = headers.split('\n')
    b = [k for k in hs if len(k)]
    e = b
    f = {(i.split(":")[0], i.split(":", 1)[1].strip()) for i in e}
    g = sorted(f)
    header = "{\n"
    for k, v in g:
        header += repr(k).replace('\'', '"') + ': ' + repr(v).replace('\'', '"') + ',\n'
    header += "}"
    return json.loads(header.replace(',\n}', '\n}'))

headers = """
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: zh-CN,zh;q=0.9
Connection: keep-alive
Content-Length: 1347
Content-Type: application/x-www-form-urlencoded
Host: recommend.browser.qq.com
Origin: https://feeds.qq.com
Referer: https://feeds.qq.com/newtab/?adtag=newtab
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.25 Safari/537.36 Core/1.70.3676.400 QQBrowser/10.4.3469.400
"""

a = get_header(headers)
print(a)
print(type(a))

成功贴图:

github传送门 --> 一键转换爬虫请求头headers