I installed pyspider on my ubuntu with the deployment guide http://docs.pyspider.org/en/latest/Deployment/. When I set fetch_type = js to render web with phantomjs. It gave me the 501 error.

Traceback (most recent call last):
      File "/usr/local/lib/python2.7/dist-packages/pyspider/libs/base_handler.py", line 188, in run_task
        result = self._run_task(task, response)
      File "/usr/local/lib/python2.7/dist-packages/pyspider/libs/base_handler.py", line 167, in _run_task
        response.raise_for_status()
      File "/usr/local/lib/python2.7/dist-packages/pyspider/libs/response.py", line 190, in raise_for_status
        raise http_error
    HTTPError: 501 Server Error

I can find the log "Web server running on port 25555" when I start the pyspider. This is my shell code and it came from the deoloyment guide.

# start **only one** scheduler instance
pyspider -c config.json scheduler

# phantomjs
pyspider -c config.json phantomjs

# start fetcher / processor / result_worker instances as many as your needs
pyspider -c config.json --phantomjs-proxy="localhost:25555" fetcher
pyspider -c config.json processor
pyspider -c config.json result_worker

# start webui, set `--scheduler-rpc` if scheduler is not running on the same host as webui
pyspider -c config.json webui

But if I just run command pyspider, it works fine with phantomjs. I tried to figure it out, but appearently I failed. The version of pyspider is 0.3.6 and phantomjs is 2.1.1.