centos python3.6安装以及scrapy框架搭建

1.yum install openssl-devel bzip2-devel expat-devel gdbm-devel readline-devel sqlite-devel gcc libpcap-devel
2.安装wegt：
3.下载python压缩包：wget https://www.python.org/ftp/python/3.6.5/Python-3.6.5.tgz
4.解压： tar -zxvf Python-3.6.5.tgz
5.移动解压的python文件：mv Python-3.6.5 /usr/local/python3
6.进入文件：cd /usr/local/python3/
7.执行三个命令（1）./configure，（2）make，（3）make install
8.删除以前python，pip的软连接：rm -rf /usr/bin/python && rm -rf /usr/bin/pip
9.建立新的python链接：ln -s /usr/local/bin/python3.6 /usr/bin/python && ln -s /usr/local/bin/pip3 /usr/bin/pip
10.测试：python -V
11.修改yum：vi /usr/bin/yum。将第一行的python改为python2
12.修改urlgrabber：vi /usr/libexec/urlgrabber-ext-down。将第一行的python改为python2。

13. vi /usr/bin/firewall-cmd同上
    14.vi /usr/bin/yum-config-manager同上
    到此python已安装完成。
    scrapy框架搭建：
    1.pip install scrapy
    2.pip install scrapyd
    3.pip install scrapydweb
    4.pip install scrapy-redis
    修改vi /usr/local/lib/python3.6/site-packag es/scrapyd/default_scrapyd.conf
    将bind 127.0.0.1改为0.0.0.0即可远程访问。
    后台启动scrapyd: nohup scrapyd > scrapyd.log 2>&1 &