一、安装Flask
pip3 install falsk
二、安装tornado
pip3 install tornado
三、安装爬虫框架
安装pyspiider
pip3 install pyspider
出错：
先安装pycurl也出同样错：pip3 install pycurl
解决：
yum install python-devel curl-devel
yum install pycurl
yum install pyspider
安装scrapy
保证依赖库已经安装
yum gruupinstall -y development tools
yum install -y epel-release libxslt-devel libxml2-devel openssl-devel
pip3 install Scrapy
报错：Could not find a version that satisfies the requirement Twisted>=13.1.0 (from Scrapy) (from versions: )
No matching distribution found for Twisted>=13.1.0 (from Scrapy)
解决：
- wget https://twistedmatrix.com/Releases/Twisted/17.1/Twisted-17.1.0.tar.bz2
- tar -jxvf Twisted-17.1.0.tar.bz2
- cd Twisted-17.1.0
- python setup.py install