tor

Scrapy, privoxy and Tor: SocketError: [Errno 61] Connection refused

由 孤街醉人 提交于 2019-12-10 10:06:55
问题 I am using Scrapy with Privoxy and Tor. Here is my previous question Scrapy with Privoxy and Tor: how to renew IP, and here is the spider: from scrapy.contrib.spiders import CrawlSpider from scrapy.selector import Selector from scrapy.http import Request class YourCrawler(CrawlSpider): name = "****" start_urls = [ 'https://****.com/listviews/titles.php', ] allowed_domains = ["****.com"] def parse(self, response): # go to the urls in the list s = Selector(response) page_list_urls = s.xpath('//

How to connect to https site with Scrapy via Polipo over TOR?

由 旧巷老猫 提交于 2019-12-10 03:26:51
问题 Not entirely sure what the problem is here. Running Python 2.7.3, and Scrapy 0.16.5 I've created a very simple Scrapy spider to test connecting to my local Polipo proxy so I can send requests out via TOR. Basic code of my spider is as follows: from scrapy.spider import BaseSpider class TorSpider(BaseSpider): name = "tor" allowed_domains = ["check.torproject.org"] start_urls = [ "https://check.torproject.org" ] def parse(self, response): print response.body For my proxy middleware, I've

tor tutorial “speaking to russia” stuck at 45 - 50%

由 混江龙づ霸主 提交于 2019-12-09 13:25:13
问题 when I try to follow the tutorial (https://stem.torproject.org/tutorials/to_russia_with_love.html) about how to start up Tor I keep getting stuck at 45% and sometimes at 50%. I am using windows 8, python 3.4 and the LiClipse ide. [1mStarting Tor: [0m [34mApr 26 12:47:21.000 [notice] Bootstrapped 0%: Starting[0m [34mApr 26 12:47:21.000 [notice] Bootstrapped 45%: Asking for relay descriptors[0m [34mApr 26 13:04:00.000 [notice] Bootstrapped 50%: Loading relay descriptors[0m The script looks like

Wrap tor socks proxy with http proxy in command line

由 一个人想着一个人 提交于 2019-12-09 04:41:24
I have installed tor via apt and it is listening on port number 9050 # netstat -ntlup | grep tor tcp 0 0 127.0.0.1:9050 0.0.0.0:* LISTEN 13566/tor Since tor is a socks proxy and I want to use that an http proxy, I installed polipo via apt and configured that as below # cat /etc/polipo/config logSyslog = true logFile = /var/log/polipo/polipo.log allowedClients = 127.0.0.1, 192.168.1.0/24 # Expose your network (modify accordingly) socksParentProxy = "localhost:9050" socksProxyType = socks5 proxyAddress = "0.0.0.0" # IPv4 only Then I restarted tor and polipo services. The polipo log says it is

GET requests in TOR network without installing TOR browser/bundle?

由 柔情痞子 提交于 2019-12-09 03:07:30
I want to perform http/https GET requests to the TOR network. My one issue is that this project needs to be scaleable, the software I'm designing needs to be light so having all users installing the TOR bundle to use with my program isn't possible. Is there someway to generate GET requests on the TOR network without having the browser? For example can I do direct requests to a TOR bridge? Yes, it's possible. Tor Browser just runs the Tor daemon in the background and proxies it's requests through it. You'll just want to install, configure, and run the daemon yourself for your application. For

Wrap tor socks proxy with http proxy in command line

由 烈酒焚心 提交于 2019-12-08 08:15:08
问题 I have installed tor via apt and it is listening on port number 9050 # netstat -ntlup | grep tor tcp 0 0 127.0.0.1:9050 0.0.0.0:* LISTEN 13566/tor Since tor is a socks proxy and I want to use that an http proxy, I installed polipo via apt and configured that as below # cat /etc/polipo/config logSyslog = true logFile = /var/log/polipo/polipo.log allowedClients = 127.0.0.1, 192.168.1.0/24 # Expose your network (modify accordingly) socksParentProxy = "localhost:9050" socksProxyType = socks5

How to specify IP country on TOR (windows)?

由 眉间皱痕 提交于 2019-12-07 22:20:56
问题 I can change that easily on linux using torrc file, but cannot find the option on tor browser for windows. It looks like it can be done via "vidalia": but how to access that ? I cannot find any vidalia on my TOR browser 回答1: The Tor Browser Bundle on Windows includes a torrc file which should be located at \Browser\TorBrowser\Data\Tor\torrc under where you install Tor Browser to. You can add or change the ExitNodes option in the file to the country you want to use (e.g. {US} ). If you're

DNS through socks proxy. How do I change windows settings for domain resolution.

由 你离开我真会死。 提交于 2019-12-07 12:46:13
问题 I am looking for a program to reroute windows domain resolution lookup through a socks proxy capable with many internet browsers and internet proxies. So far in Control Panel, Local Area Connection 1, TCP/IP Properties, I use the following DNS server addresses, preferred DNS Server, I put 127.0.0.1 and use the default in-built port request 53. I am reading that it is possible to forward this. I can not find a program to forward it through socks 4/5. I think this is possible because Socks

How i can get new ip from tor every requests in threads?

由 给你一囗甜甜゛ 提交于 2019-12-07 10:47:07
问题 I try to use TOR proxy for scraping and everything works fine in one thread, but this is slow. I try to do something simple: def get_new_ip(): with Controller.from_port(port = 9051) as controller: controller.authenticate(password="password") controller.signal(Signal.NEWNYM) time.sleep(controller.get_newnym_wait()) def check_ip(): get_new_ip() session = requests.session() session.proxies = {'http': 'socks5h://localhost:9050', 'https': 'socks5h://localhost:9050'} r = session.get('http://httpbin

C# combining GeckoFX + Tor.NET libraries

由 旧时模样 提交于 2019-12-06 09:56:35
问题 I am trying to combine GeckoFx library and Tor.NET library. In my code I do all preparing to use tor network, ClientCreateParams createParameters = new ClientCreateParams(); createParameters.ConfigurationFile = ConfigurationManager.AppSettings["torConfigurationFile"]; createParameters.ControlPassword = ConfigurationManager.AppSettings["torControlPassword"]; createParameters.ControlPort = Convert.ToInt32(ConfigurationManager.AppSettings["torControlPort"]); createParameters
订阅 tor