web scraper浏览器插件,比爬虫好使亿点...

长话短说。
安装插件后import sitement

{"_id":"auhhua","startUrl":["https://m.weibo.cn/2175434057/4575191730753625"],"selectors":[{"id":"评论滚动","type":"SelectorElementScroll","selector":"div.card-main > div.m-box","parentSelectors":["_root"],"multiple":true,"delay":"2000"},{"id":"评论内容","type":"SelectorText","selector":"div.m-box h3","parentSelectors":["评论滚动"],"multiple":true,"regex":"","delay":0},{"id":"点赞量","type":"SelectorText","selector":"aside:nth-of-type(2) em","parentSelectors":["评论滚动"],"multiple":false,"regex":"","delay":0}]}

将url替换成微博链接,可自动滑动并且爬取评论,但是不知道数据的排序依据。
web scraper浏览器插件,比爬虫好使亿点..._第1张图片
具体教程请参考知乎田老师大神:
zhuanlan.zhihu.com/p/89551741?from_voters_page=true
over

你可能感兴趣的:(python,爬虫,html,typescript)