Geek asks and answers

Could not solve Python mechanical join problem

I run the crawler, it works fine on MAC and Ubuntu. When I run it in windows, it displays the following stack trace:

  File "build\bdist.win32\egg\mechanize\_mechanize.py", line 203, in open
    return self._mech_open(url, data, timeout=timeout)
  File "build\bdist.win32\egg\mechanize\_mechanize.py", line 230, in _mech_open
    response = UserAgentBase.open(self, request, data)
  File "build\bdist.win32\egg\mechanize\_opener.py", line 193, in open
    response = urlopen(self, req, data)
  File "build\bdist.win32\egg\mechanize\_urllib2_fork.py", line 344, in _open
    '_open', req)
  File "build\bdist.win32\egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
    result = func(*args)
  File "build\bdist.win32\egg\mechanize\_urllib2_fork.py", line 1170, in https_open
    return self.do_open(conn_factory, req)
  File "build\bdist.win32\egg\mechanize\_urllib2_fork.py", line 1118, in do_open
    raise URLError(err)
URLError: <urlopen error [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond>
+3
source share
2 answers

I doubt very much that the problem is with your system. To fix this problem, I would recommend:

  • Check the mechanization version . Older versions can handle requests differently.
  • Learn set_handle_robotsand addheaders. The problem may be due to too many requests for each IP address. (I suspect this is a real problem.)
  • . , .

, , .

+5

, , , .

telnet, , URL/IP:PORT, :

telnet <ip> <port>

PS: , ping, , .

+1

More articles:


All Articles