pyspider与MongoDB部署时遇到哪些具体问题?

更新于
2026-07-27 18:37:29
18阅读来源:SEO问题
  • 内容介绍
  • 文章标签
  • 相关推荐

本文共计483个文字,预计阅读时间需要2分钟。

pyspider与MongoDB部署时遇到哪些具体问题?

当执行`pyspider -c config.json`命令时遇到错误:phantomjs not found, continue running without it.,这可能是因为系统未找到phantomjs。以下是简化后的错误信息:

pyspider -c config.json: phantomjs not found, continue running without it.

如题pyspider-cconfig.json后报错:

如题 pyspider -c config.json 后报错:

pyspider与MongoDB部署时遇到哪些具体问题?

12345678910111213141516171819202122232425262728293031323334353637[W 151225 17:29:08 run:398] phantomjs not found, continue running without it.[I 151225 17:29:10 result_worker:49] result_worker starting...[I 151225 17:29:11 tornado_fetcher:429] fetcher starting...[I 151225 17:29:11 scheduler:453] loading projects[I 151225 17:29:11 processor:208] processor starting...Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'

   

本文共计483个文字,预计阅读时间需要2分钟。

pyspider与MongoDB部署时遇到哪些具体问题?

当执行`pyspider -c config.json`命令时遇到错误:phantomjs not found, continue running without it.,这可能是因为系统未找到phantomjs。以下是简化后的错误信息:

pyspider -c config.json: phantomjs not found, continue running without it.

如题pyspider-cconfig.json后报错:

如题 pyspider -c config.json 后报错:

pyspider与MongoDB部署时遇到哪些具体问题?

12345678910111213141516171819202122232425262728293031323334353637[W 151225 17:29:08 run:398] phantomjs not found, continue running without it.[I 151225 17:29:10 result_worker:49] result_worker starting...[I 151225 17:29:11 tornado_fetcher:429] fetcher starting...[I 151225 17:29:11 scheduler:453] loading projects[I 151225 17:29:11 processor:208] processor starting...Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'