python爬虫,发送请求需要携带cookies

此网站,需要先注册登录!!!

页面源代码:


我的首页 - 雪球

上证指数

————
————

深证成指

————
————

创业板指

————
————
------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------------------------

悬赏提问常见问题

有问题不知道问谁?
试试悬赏提问

发起悬赏

其他服务

其他建议反馈欢迎点击 #我给雪球提建议#

如受到欺诈信息骚扰请至 #防诈骗举报专区#

python代码:

import requests

headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36',
    'Host': 'xueqiu.com',
    'Referer': 'https://xueqiu.com/',
    'Cookie': 'cookiesu=411700482632361; device_id=29270365565b168f60a35e878597d7a3; s=am11lj11rm; __utmz=1.1700482786.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);acw_tc=2760825d17051362899667830e47536d0c8ad57ed00a73bbefb6c4b513e5ee; Hm_lvt_1db88642e346389874251b5a1eded6e3=1705136319; u=6608945068; snbim_minify=true; bid=4e57f453e306324b754929f18b8e3530_lrbu8ecs; __utma=1.2074947920.1700482786.1700482786.1705136477.2; __utmc=1; __utmt=1; remember=1; xq_a_token=34346c84cf49fc520a74b727e01a599d017d6960;xqat=34346c84cf49fc520a74b727e01a599d017d6960;xq_id_token=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJ1aWQiOjY2MDg5NDUwNjgsImlzcyI6InVjIiwiZXhwIjoxNzA3NzI4NjM2LCJjdG0iOjE3MDUxMzY2MzYzNDYsImNpZCI6ImQ5ZDBuNEFadXAifQ.SEcNWjvbF4GwO-dVZY-AJxXJ3TBTqGqV_Xac5S034vvnx5cYicltppGpv4vfXjzFSdgMYhby1cLR0CzxAKjtbItJre1ZIz_814TC8v4524L0LajorvNNujiF_9FccrZ6Z1PT-GZ6l1Q8n22s3KxafEGM64Hr2VK6KoWJpwTzvSywD3SUwUoNTuHLV0Pm2fn9esdB9mcnCTZkRA3HiRlVh7XcBY7K8T9frLbMTG9ssXZ1JzDjaGwB07fAxRLteblFWWbelk8db77ZK066q7OlZ1bVexVBHdqkXu_vh2Snfud9f8x3_Sjj7a_byBgL5A5L5MJWpmrmZHqJlyKCXiLGQ; xq_r_token=2f87a9dd64211e24c310cb58f2169f0f6e91723c; xq_is_login=1; Hm_lpvt_1db88642e346389874251b5a1eded6e3=1705136778; __utmb=1.9.10.1705136477; is_overseas=0',
}
url = 'https://xueqiu.com/statuses/hot/listV2.json?since_id=-1&max_id=366242&size=15'

response = requests.get(url, headers=headers)
print(response.json())

运行结果:有数据

{'next_max_id': -1, 'items': [], 'next_id': -1}

此实例只是为了验证,某些网站反爬必须需要携带cookies。

你可能感兴趣的:(案例,python,python,爬虫,开发语言)