Apache HTTPClient throws java.net.SocketException: Connection reset for many domains

Question

I\'m creating a (well behaved) web spider and I notice that some servers are causing Apache HttpClient to give me a SocketException -- specifically:

java.net         


        

Answer 1

Try getting a network trace using wireshark, and augment that with log4j logging of the HTTPClient. That should show why the connection is being reset