Week 1_Practice 1.3_Crawling Housing Information from Pages

This time, we want to crawl all the detailed housing information from the first 20 pages. The basic idea behind this should be: first, get all the individual urls from the 20 pages and form a list, and then loop through the url list, go into the single page, and retrieve the details. 

The website to be crawled looks like:

Week 1_Practice 1.3_Crawling Housing Information from Pages_第1张图片
Week 1_Practice 1.3_Crawling Housing Information from Pages_第2张图片

The information we want to retrieve are "host-gender", "house title", "room image link", "host-name", "host-picture", "price", and "address". 

Week 1_Practice 1.3_Crawling Housing Information from Pages_第3张图片


I have learnt a systematic method to write a Python program. The structure of a basic Python application program looks like:

#!/us

你可能感兴趣的:(Week 1_Practice 1.3_Crawling Housing Information from Pages)