I use scrapy for the project. I ran the following commands to deploy the project:
$scrapy deploy -l
Then I got the following o / p:
scrapysite http://localhost:6800/
$cat scrapy.cfg
[settings]
default = scrapBib.settings
[deploy:scrapysite]
url = http://localhost:6800/
project = scrapBib
$scrapy deploy scrapysite -p scrapBib
'Building egg of scrapBib-1346242513
'build/lib.linux-x86_64-2.7' does not exist -- can't clean it
'build/bdist.linux-x86_64' does not exist -- can't clean it
'build/scripts-2.7' does not exist -- can't clean it
zip_safe flag not set; analyzing archive contents...
Deploying scrapBib-1346242513 to `http:`
2012-08-29 17:45:14+0530 [HTTPChannel,22,127.0.0.1] 127.0.0.1 - - [29/Aug/2012:12:15:13
+0000] "POST /addversion.json HTTP/1.1" 200 79 "-" "Python-urllib/2.7"
Server response (200):
{"status": "ok", "project": "scrapBib", "version": "1346242513", "spiders": 0}
As you can see, getting spiders as 0, although I wrote 3 spiders inside the project / spiders / folder. As a result, I cannot start a crawl request. Please, help
source
share