curl-multi

How can I open a web-page and receive its cookies using PHP? The motivation : I am trying to use feed43 to create an RSS feed from the non-RSS-enabled HighLearn website (remote learning website). I found the web-page that contains the feed contents I need to parse, however, it requires to login first. Luckily, logging in can be done via a GET request so it's as easy as fopen()ing " http://highlearn.website/login_page.asp?userID=foo&password=bar " for example. But I still need to get the cookies generated when I logged in , pass the cookies to the real client (using setcookie() maybe?) and then

Is it possible to chain multiple proxies in a single request using cURL? For example: start cURL -> proxy1 -> proxy2 -> destination address Can this be achieved using cURL? A proxy is by definition a middle man. Software running and doing work between the client and the server. The client asks the proxy which then it turn asks the server. "Chained" proxies would then imply that a first proxy would ask a second proxy, but as the client asks the proxy to do its request it cannot be the job of the client to ask the second proxy, but it must be the first proxy's task. Alas: sure, if you have a

I am writing an interface in which I must launch 4 http requests to get some infomation. I implemented the interface in 2 ways: using sequential file_get_contents. using multi curl. I have benchmarked the 2 versions with jmeter. The result shows that multi curl is much better than sequential file_get_contents when there's only 1 thread in jmeter making requests, but much worse when 100 threads. The question is: which could bring the bad performance of multi curl? My multi curl code is as below: $curl_handle_arr = array (); $master = curl_multi_init(); foreach ( $call_url_arr as $key => $url )

I'm working on an app that gets all the URLs from an array of sites and displays it in array form or JSON. I can do it using for loop, the problem is the execution time when I tried 10 URLs it gives me an error saying exceeds maximum execution time . Upon searching I found this multi curl I also found this Fast PHP CURL Multiple Requests: Retrieve the content of multiple URLs using CURL . I tried to add my code but didn't work because I don't how to use the function. Hope you help me. Thanks. This is my sample code. <?php $urls=array( 'http://site1.com/', 'http://site2.com/', 'http://site3.com

I have a data aggregator that relies on scraping several sites, and indexing their information in a way that is searchable to the user. I need to be able to scrape a vast number of pages, daily, and I have ran into problems using simple curl requests, that are fairly slow when executed in rapid sequence for a long time (the scraper runs 24/7 basically). Running a multi curl request in a simple while loop is fairly slow. I speeded it up by doing individual curl requests in a background process, which works faster, but sooner or later the slower requests start piling up, which ends up crashing

I am trying to batch/bulk upload from localhost (xampp) to my S3 bucket. It seems to work for about 6 items then i get an error message: The cURL error says Failed sending network data. from http://curl.haxx.se/libcurl/c/libcurl-errors.html Fatal error: Uncaught exception 'cURL_Multi_Exception' with message 'cURL resource: Resource id #34; cURL error: SSL_write() returned SYSCALL, errno = 0 (cURL error code 55). See http://curl.haxx.se/libcurl/c/libcurl-errors.html for an explanation of error codes.' in D:\xampp\htdocs\path\to\my\files\sdk-1.5.14\lib\requestcore\requestcore.class.php on line