Geek asks and answers

Sharing Worker Curl Handlers

I have a work reducer (called a “manager”) that reads a list of URLs, and then calls for each of them another relay employee (called a “dependent”), which retrieves the contents of the passed URL and does some work on it - indexing, etc. Each URL belongs to one domain (for example: www.test.com). When every worker calls curl_init(), a new connection occurs at www.test.com.

I am looking for a method for sharing a curl resource handler among workers to reuse the same connection. In my case, manager could create a resource handler and then pass it to dependents as a workload parameter.

+5
source share
1 answer

You can use shared memory to store a variable with semaphore functions, http://www.php.net/manual/en/book.sem.php .

Or you can use APC and upload cached variables to a file. But I do not know how this will work.

0
source

More articles:


All Articles