Python爬取 豆瓣电影:《肖申克的救赎》

本文的思路是按照BeautifulSoup4文档(链接地址:https://www.crummy.com/software/BeautifulSoup/bs4/doc.zh/index.html)写的.

爬取网址:https://movie.douban.com/subject/1292052/

1,获得网址源码(可以利用网站的查看元素直接查看):

import requests
from bs4 import BeautifulSoup
import re
import numpy as np
import csv
import time

url = 'https://movie.douban.com/subject/1292052/'
data = requests.get(url).text

print(data)

2,获得电影名（知识点对应文档中 对象种类 ）:

本段代码目的:获取title标签及其内容

import requests
from bs4 import BeautifulSoup
import re
import numpy as np
import csv
import time

url = 'https://movie.douban.com/subject/1292052/'
data = requests.get(url).text
soup=BeautifulSoup(data,'lxml')
title1=soup.title

print(title1)

 

结果比预期多了一对