系统环境
本文不含内容
使用Pycharm Clone pyspider

访问Pyspider项目地址:https://github.com/binux/pyspider
拿到项目git url:https://github.com/binux/pyspider.git
贴入下图URL框,下面框指定项目保存路径.
填写好后点击clone等待项目下载.

Pycharm创建venv(全称virtualenv)
安装PycURL(必须!!!)
本次使用的机器是win7 64位,python3.7 32位,选择的文件见下面示例语句
pip install your_download_file_full_path_name 举例: (venv) D:\workspace\pycharm\pyspider>pip install D:\developSetup\pythonpackage\pycurl-7.43.0.3-cp37-cp37m-win32.whl
安装 requirements.txt
(venv) D:\workspace\pycharm\pyspider>python -m pip install --upgrade pip Looking in indexes: http://mirrors.aliyun.com/pypi/simple/ Collecting pip Downloading http://mirrors.aliyun.com/pypi/packages/8d/07/f7d7ced2f97ca3098c16565efbe6b15fafcba53e8d9bdb431e0b0/pip-19.2. 2-py2.py3-none-any.whl (1.4MB)
运行
terminal输入run.py
(venv) D:\workspace\pycharm\pyspider>run.py D:\workspace\pycharm\pyspider\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform. warnings.warn("timeout is not supported on your platform.", FutureWarning) [W 11:44:37 run:422] phantomjs not found, continue running without it. [W 11:44:39 run:465] puppeteer not found, continue running without it. [I 11:44:41 result_worker:49] result_worker starting... [I 11:44:42 processor:211] processor starting... [I 11:44:43 scheduler:675] scheduler starting... [I 11:44:43 scheduler:614] in 5m: new:0,success:0,retry:0,failed:0 [I 11:44:43 tornado_fetcher:745] fetcher starting... [I 11:44:44 scheduler:810] scheduler.xmlrpc listening on 127.0.0.1:23333 [W 11:44:46 app:61] WebDav interface not enabled: ModuleNotFoundError("No module named 'wsgidav'") [I 11:44:46 app:76] webui running on 0.0.0.0:5000 [I 11:45:43 scheduler:614] in 5m: new:0,success:0,retry:0,failed:0
端口号是5000
[I 11:44:46 app:76] webui running on 0.0.0.0:5000
发布者:全栈程序员-站长,转载请注明出处:https://javaforall.net/173941.html原文链接:https://javaforall.net
