使用requests-html
若遇到下面问题:
pyppeteer.errors.BrowserError: Browser closed unexpectedly:
/home/user/.local/share/pyppeteer/local-chromium/575458/chrome-linux/chrome: error while loading shared libraries: libX
11-xcb.so.1: cannot open shared object file: No such file or directory
可以安装下面的库解决
sudo apt install libx11-xcb1 libxcomposite-dev libxcursor-dev libxdamage-dev libxi-dev libxtst-dev libxss-dev libxrandr-dev
sudo apt install libnss3 libcups2 libasound-dev libpangocairo-1.0 libatk1.0-dev libatk-bridge2.0-dev libgtk-3-0