windows 安装scrapy
先安装python2.7
python2.7
安装pip
教程:pip
切换到cmd 管理员
C:\Users\wd\Downloads>python get-pip.pyC:\Users\wd\Downloads>python get-pip.py
Collecting pip
Using cached pip-9.0.1-py2.py3-none-any.whl
Collecting setuptools
Using cached setuptools-35.0.2-py2.py3-none-any.whl
Collecting wheel
Using cached wheel-0.29.0-py2.py3-none-any.whl
Collecting appdirs>=1.4.0 (from setuptools)
Using cached appdirs-1.4.3-py2.py3-none-any.whl
Collecting packaging>=16.8 (from setuptools)
Using cached packaging-16.8-py2.py3-none-any.whl
Collecting six>=1.6.0 (from setuptools)
Using cached six-1.10.0-py2.py3-none-any.whl
Collecting pyparsing (from packaging>=16.8->setuptools)
Using cached pyparsing-2.2.0-py2.py3-none-any.whl
Installing collected packages: pip, appdirs, pyparsing, six, packaging, setuptools, wheel
Successfully installed appdirs-1.4.3 packaging-16.8 pip-9.0.1 pyparsing-2.2.0 setuptools-35.0.2 six-1.10.0 wheel-0.29.0
C:\Users\wd\Downloads>pip
Usage:
pip [options]
Commands:
install Install packages.
download Download packages.
uninstall Uninstall packages.
freeze Output installed packages in requirements format.
list List installed packages.
show Show information about installed packages.
check Verify installed packages have compatible dependencies.
search Search PyPI for packages.
wheel Build wheels from your requirements.
hash Compute hashes of package archives.
completion A helper command used for command completion.
help Show help for commands.
General Options:
-h, --help Show help.
--isolated Run pip in an isolated mode, ignoring
environment variables and user configuration.
-v, --verbose Give more output. Option is additive, and can be
used up to 3 times.
-V, --version Show version and exit.
-q, --quiet Give less output. Option is additive, and can be
used up to 3 times (corresponding to WARNING,
ERROR, and CRITICAL logging levels).
--log Path to a verbose appending log.
--proxy Specify a proxy in the form
[user:passwd@]proxy.server:port.
--retries Maximum number of retries each connection should
attempt (default 5 times).
--timeout Set the socket timeout (default 15 seconds).
--exists-action Default action when a path already exists:
(s)witch, (i)gnore, (w)ipe, (b)ackup, (a)bort.
--trusted-host Mark this host as trusted, even though it does
not have valid or any HTTPS.
--cert Path to alternate CA bundle.
--client-cert Path to SSL client certificate, a single file
containing the private key and the certificate
in PEM format.
--cache-dir Store the cache data in .
--no-cache-dir Disable the cache.
--disable-pip-version-check
Don't periodically check PyPI to determine
whether a new version of pip is available for
download. Implied with --no-index.
C:\>pip install pypiwin32
Collecting pypiwin32
Downloading pypiwin32-219-cp27-none-win_amd64.whl (7.3MB)
100% |████████████████████████████████| 7.3MB 164kB/s
Installing collected packages: pypiwin32
Successfully installed pypiwin32-219
C:\>pip install pillow
Collecting pillow
Downloading Pillow-4.1.1-cp27-cp27m-win_amd64.whl (1.4MB)
100% |████████████████████████████████| 1.4MB 365kB/s
Collecting olefile (from pillow)
Downloading olefile-0.44.zip (74kB)
100% |████████████████████████████████| 81kB 890kB/s
Building wheels for collected packages: olefile
Running setup.py bdist_wheel for olefile ... done
Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\20\58\49\cc7bd00345397059149a10b0259ef38b867935ea2ecff99a9b
Successfully built olefile
Installing collected packages: olefile, pillow
Successfully installed olefile-0.44 pillow-4.1.1
C:\>pip install pymongo
Collecting pymongo
Downloading pymongo-3.4.0-cp27-none-win_amd64.whl (267kB)
100% |████████████████████████████████| 276kB 1.1MB/s
Installing collected packages: pymongo
Successfully installed pymongo-3.4.0C:\>pip install pypiwin32
Collecting pypiwin32
Downloading pypiwin32-219-cp27-none-win_amd64.whl (7.3MB)
100% |████████████████████████████████| 7.3MB 164kB/s
Installing collected packages: pypiwin32
Successfully installed pypiwin32-219
C:\>pip install pillow
Collecting pillow
Downloading Pillow-4.1.1-cp27-cp27m-win_amd64.whl (1.4MB)
100% |████████████████████████████████| 1.4MB 365kB/s
Collecting olefile (from pillow)
Downloading olefile-0.44.zip (74kB)
100% |████████████████████████████████| 81kB 890kB/s
Building wheels for collected packages: olefile
Running setup.py bdist_wheel for olefile ... done
Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\20\58\49\cc7bd00345397059149a10b0259ef38b867935ea2ecff99a9b
Successfully built olefile
Installing collected packages: olefile, pillow
Successfully installed olefile-0.44 pillow-4.1.1
C:\>pip install pymongo
Collecting pymongo
Downloading pymongo-3.4.0-cp27-none-win_amd64.whl (267kB)
100% |████████████████████████████████| 276kB 1.1MB/s
Installing collected packages: pymongo
Successfully installed pymongo-3.4.0
C:\>pip install scrapy
Collecting scrapy
Downloading Scrapy-1.4.0-py2.py3-none-any.whl (248kB)
100% |████████████████████████████████| 256kB 226kB/s
Collecting service-identity (from scrapy)
Downloading service_identity-17.0.0-py2.py3-none-any.whl
Collecting parsel>=1.1 (from scrapy)
Downloading parsel-1.2.0-py2.py3-none-any.whl
Requirement already satisfied: six>=1.5.2 in c:\program files\python2.7\lib\site-packages (from scrapy)
Collecting w3lib>=1.17.0 (from scrapy)
Downloading w3lib-1.17.0-py2.py3-none-any.whl
Collecting lxml (from scrapy)
Downloading lxml-3.7.3-cp27-none-win_amd64.whl (3.4MB)
100% |████████████████████████████████| 3.5MB 181kB/s
Requirement already satisfied: Twisted>=13.1.0 in c:\program files\python2.7\lib\site-packages (from scrapy)
Collecting cssselect>=0.9 (from scrapy)
Downloading cssselect-1.0.1-py2.py3-none-any.whl
Collecting PyDispatcher>=2.0.5 (from scrapy)
Downloading PyDispatcher-2.0.5.tar.gz
Collecting queuelib (from scrapy)
Downloading queuelib-1.4.2-py2.py3-none-any.whl
Collecting pyOpenSSL (from scrapy)
Downloading pyOpenSSL-17.0.0-py2.py3-none-any.whl (51kB)
100% |████████████████████████████████| 61kB 218kB/s
Collecting pyasn1 (from service-identity->scrapy)
Downloading pyasn1-0.2.3-py2.py3-none-any.whl (53kB)
100% |████████████████████████████████| 61kB 71kB/s
Requirement already satisfied: attrs in c:\program files\python2.7\lib\site-packages (from service-identity->scrapy)
Collecting pyasn1-modules (from service-identity->scrapy)
Downloading pyasn1_modules-0.0.8-py2.py3-none-any.whl
Requirement already satisfied: Automat>=0.3.0 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)
Requirement already satisfied: constantly>=15.1 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)
Requirement already satisfied: incremental>=16.10.1 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)
Requirement already satisfied: zope.interface>=3.6.0 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)
Collecting cryptography>=1.7 (from pyOpenSSL->scrapy)
Downloading cryptography-1.8.2-cp27-cp27m-win_amd64.whl (1.3MB)
100% |████████████████████████████████| 1.3MB 242kB/s
Requirement already satisfied: setuptools in c:\program files\python2.7\lib\site-packages (from zope.interface>=3.6.0->Twisted>=13.1.0->scrapy)
Collecting idna>=2.1 (from cryptography>=1.7->pyOpenSSL->scrapy)
Downloading idna-2.5-py2.py3-none-any.whl (55kB)
100% |████████████████████████████████| 61kB 231kB/s
Collecting cffi>=1.4.1 (from cryptography>=1.7->pyOpenSSL->scrapy)
Downloading cffi-1.10.0-cp27-cp27m-win_amd64.whl (157kB)
100% |████████████████████████████████| 163kB 251kB/s
Requirement already satisfied: packaging in c:\program files\python2.7\lib\site-packages (from cryptography>=1.7->pyOpenSSL->scrapy)
Collecting ipaddress (from cryptography>=1.7->pyOpenSSL->scrapy)
Downloading ipaddress-1.0.18-py2-none-any.whl
Collecting asn1crypto>=0.21.0 (from cryptography>=1.7->pyOpenSSL->scrapy)
Downloading asn1crypto-0.22.0-py2.py3-none-any.whl (97kB)
100% |████████████████████████████████| 102kB 344kB/s
Collecting enum34 (from cryptography>=1.7->pyOpenSSL->scrapy)
Downloading enum34-1.1.6-py2-none-any.whl
Requirement already satisfied: appdirs>=1.4.0 in c:\program files\python2.7\lib\site-packages (from setuptools->zope.interface>=3.6.0->Twisted>=13.1.0->scrapy)
Collecting pycparser (from cffi>=1.4.1->cryptography>=1.7->pyOpenSSL->scrapy)
Downloading pycparser-2.17.tar.gz (231kB)
100% |████████████████████████████████| 235kB 261kB/s
Requirement already satisfied: pyparsing in c:\program files\python2.7\lib\site-packages (from packaging->cryptography>=1.7->pyOpenSSL->scrapy)
Building wheels for collected packages: PyDispatcher, pycparser
Running setup.py bdist_wheel for PyDispatcher ... done
Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\86\02\a1\5857c77600a28813aaf0f66d4e4568f50c9f133277a4122411
Running setup.py bdist_wheel for pycparser ... done
Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\a8\0b\41\dc95621f9d3a0da7bc191b8a71f0e8182ffd3cc5f33ac55005
Successfully built PyDispatcher pycparser
Installing collected packages: pyasn1, idna, pycparser, cffi, ipaddress, asn1crypto, enum34, cryptography, pyOpenSSL, pyasn1-modules, service-identity, w3lib, cssselect, lxml, parsel, PyDispatcher, queuelib, scrapy
Successfully installed PyDispatcher-2.0.5 asn1crypto-0.22.0 cffi-1.10.0 cryptography-1.8.2 cssselect-1.0.1 enum34-1.1.6 idna-2.5 ipaddress-1.0.18 lxml-3.7.3 parsel-1.2.0 pyOpenSSL-17.0.0 pyasn1-0.2.3 pyasn1-modules-0.0.8 pycparser-2.17 queuelib-1.4.2 scrapy-1.4.0 service-identity-17.0.0 w3lib-1.17.0
C:\Users\wd\Downloads>scrapy
Scrapy 1.4.0 - no active project
Usage:
scrapy [options] [args]
Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy -h" to see more info about a command
C:\Users\wd\Downloads>