timeout

Python web scraping: difference between sleep and request(page, timeout=x)

旧时模样 提交于 2020-01-23 03:59:07
问题 When scraping multiple websites in a loop, I notice there is a rather large difference in speed between, sleep(10) response = requests.get(url) and, response = requests.get(url, timeout=10) That is, timeout is much faster. Moreover, for both set-ups I expected a scraping duration of at least 10 seconds per page before requesting the next page, but this is not the case. Why is there such a difference in speed? Why is the scraping duration per page less than 10 seconds? I now use

encountering “Read timeout expired” error by Webhook after 60 Sec of execution

这一生的挚爱 提交于 2020-01-23 03:59:07
问题 lately Im facing a problem with telegram bot api which i haven't had before... Im using Webhook method of connection to catch bot requests and respoding with PHP script and sometimes the triggered script takes more than a minute to finish processing. about a month ago everything was working fine and telegram bot wait long enough for script to completely execute, but now my connection suspend and im getting this Webhook error through telegram api "Read timeout expired" after 60 Seconds of

Change WCF default timeout

≯℡__Kan透↙ 提交于 2020-01-23 00:35:12
问题 I have here a WCF Duplex Service, the requierement is that the Callback to the client should have a timeout of 10 seconds, therefor my web.config file of the Service looks like this: <bindings> <basicHttpBinding> <binding name="simulatorEndpoint" closeTimeout="00:00:10" openTimeout="00:00:10" receiveTimeout="00:00:10" sendTimeout="00:00:10" allowCookies="false" bypassProxyOnLocal="false" hostNameComparisonMode="StrongWildcard" maxBufferSize="65536" maxBufferPoolSize="524288"

Timed out after 30000ms when I tried to go next page by clicking Submit button using Selenium RC

我是研究僧i 提交于 2020-01-21 14:56:26
问题 I am using Selenium RC by java. Fill up necessary data on 1st page--> Click Submit button to go next page. My code is: selenium.click("Submit"); selenium.waitForPageToLoad("30000"); After clicking Submit button I found the error: com.thoughtworks.selenium.SeleniumException: Timed out after 30000ms Can anybody pls help me? 回答1: Selenium.waitforpagetoload("30000"); means you are giving time 30000 m.s= 30 seconds It means your page is taking more than 30 seconds to load completely. So in order

WCF Timeout issue?

狂风中的少年 提交于 2020-01-21 03:32:08
问题 I have a somewhat long-taking WCF-based process. WCF service runs in Azure if its of any help. The issue I believe has to do with timeouts: 1) Winforms client has the following .config setting in the binding section: <wsHttpBinding> <binding name="XXX" closeTimeout="00:05:00" openTimeout="00:05:00" receiveTimeout="00:10:00" sendTimeout="00:10:00" bypassProxyOnLocal="false" transactionFlow="false" hostNameComparisonMode="StrongWildcard" maxBufferPoolSize="10000000" maxReceivedMessageSize=

How do I set a SQL Server script's timeout from within the script?

余生长醉 提交于 2020-01-20 04:54:45
问题 I have a large script file (nearly 300MB, and feasibly bigger in the future) that I am trying to run. It has been suggested in the comments of Gulzar's answer to my question about it that I should change the script timeout to 0 (no timeout). What is the best way to set this timeout from within the script? At the moment I have all of this at the top of the script file in the hopes that one of them does something: sp_configure 'remote login timeout', 600 go sp_configure 'remote query timeout',

Why does session_start cause a timeout when one script calls another script using curl

佐手、 提交于 2020-01-19 12:55:08
问题 I have two PHP scripts, both using the same session by calling session_name('MySessID') . When the first script calls the second script using curl, the second script hangs when session_start() is called. Why would this happend? 回答1: From the php manual http://php.net/manual/en/function.session-write-close.php Session data is usually stored after your script terminated without the need to call session_write_close(), but as session data is locked to prevent concurrent writes only one script may

flex air httpservice stream error and timing out

£可爱£侵袭症+ 提交于 2020-01-17 05:42:07
问题 We have an AIR client sending HTTPService Post request to Tomcat. The operation takes more than 30 seconds in the server since its a files transfer operation. By the time the server returns the response, Flex is throwing a fault, 2032, stream error ( checked a lot on the net ) Looks like its timing out after 30 seconds, waiting for the Http response. i tried setting ht.requestTimeout, it did not work. Setting URLRequestDefaults.idleTimeout also is not working. Looks like i have hit a dead end

WebRequest.Create - The operation has timed out

岁酱吖の 提交于 2020-01-16 18:16:29
问题 I'm trying to crawl a couple of pages on my own site, but I'm getting a time-out webException("The operation has timed out") on my live environment but not on my test environment. The time-out does not occur on the same page twice, but randomly and often after some requests. After the first time-out, the frequency of the time-outs rises. The requestUristring on test enviroment: http://localhost/Opgaver/Flytning/Haarde-hvidevarer/Bortkoersel-amerikaner-koeleskab-paa.aspx The requestUristring

WebRequest.Create - The operation has timed out

喜夏-厌秋 提交于 2020-01-16 18:16:08
问题 I'm trying to crawl a couple of pages on my own site, but I'm getting a time-out webException("The operation has timed out") on my live environment but not on my test environment. The time-out does not occur on the same page twice, but randomly and often after some requests. After the first time-out, the frequency of the time-outs rises. The requestUristring on test enviroment: http://localhost/Opgaver/Flytning/Haarde-hvidevarer/Bortkoersel-amerikaner-koeleskab-paa.aspx The requestUristring