Geek asks and answers

CURL fails after many runs say "connection failed" or "connect ()

I am trying to index many hundrets of web pages.

In short

  • Calling a PHP script using a CRON job
  • Getting some (about 15 in total) from the last updated URLs
  • Request URLs using CURL

Problem

In development, everything went fine. But when I started indexing much more than some test pages, CURL refused to work after some runs. It does not receive any data from the remote server.

Error messages

These CURL errors printed (of course, not immediately)

  • failed to connect to host
  • Operation completed after 60,000 milliseconds with 0 bytes received

V- Firefox wget. . .

, .

DDOS- - , , , ?

+3
2

, , IP- DDOS .

: ( -)

1. .

2.

3.Random Referers

4. .

5.Random Delay .

, script .

ignore_user_abort(1);
set_time_limit(0);

, url , .

+1

script? DOS- . , , .

+1

More articles:


All Articles