mechanize

I'm trying to do the following: page = Mechanize.new.get "https://sis-app.sph.harvard.edu:9030/prod/bwckschd.p_disp_dyn_sched" But I only get this exception: OpenSSL::SSL::SSLError: SSL_connect returned=1 errno=0 state=SSLv2/v3 read server hello A: sslv3 alert illegal parameter from /Users/amosng/.rvm/gems/ruby-1.9.3-p194/gems/net-http-persistent-2.7/lib/net/http/persistent/ssl_reuse.rb:70:in `connect' from /Users/amosng/.rvm/gems/ruby-1.9.3-p194/gems/net-http-persistent-2.7/lib/net/http/persistent/ssl_reuse.rb:70:in `block in connect' from /Users/amosng/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1

I know you have a set of pre-defined aliases you can use by setting agent.user_agent_alias = 'Linux Mozilla' for instance, but what if I want to set my own user agent, as I'm writing a web crawler and want to identify it, for the sites I'm indexing's sake. Just like Googlebot. There seems to be a user_agent method, but I can't seem to find any documentation about it's function. You can set the user agent from an alias a = Mechanize.new a.user_agent_alias = 'Mac Safari' Available aliases are stored in the AGENT_ALIASES constant. p Mechanize::AGENT_ALIASES Otherwise, use #user_agent to set your

is there any way how to use Mechanize with Python 3.x? Or is there any substitute which works in Python 3.x? I've been searching for hours, but I didn't find anything :( I'm looking for way how to login to the site with Python, but the site uses javascript. Thanks in advance, Adam. lxml.html provides form handling facilities and supports Python 3. I'm working on a similar project, but the faq for mechanize explicitly says they don't intend on supporting 3x any time soon. Is there a reason the code has to be written in 3? The way I'm trying to tackle the problem is by emulating the java script

I am interested in automating repetitive data entry in some forms for a website I frequent. So far the tools I've looked up that would provide support for this in a headless fashion could be Selenium WebDriver and Mechanize. My question is, is there a fundamental technical difference in using once versus the other? Selenium is mostly used for testing. I've also noticed some folks use it for doing exactly what I'm looking for, and that's automating data entry. Testing becomes a second benefit in that case. Is there reasons to not use Selenium for what I want to do over Mechanize? Does it not

I have a CookieJar that's being used with mechanize that I want to add a cookie to. How can I go about doing this? make_cookie() and set_cookie() weren't clear enough for me. br = mechanize.Browser() cj = cookielib.LWPCookieJar() br.set_cookiejar(cj) Paul Managed to figure this out import mechanize import cookielib br = mechanize.Browser() cj = cookielib.LWPCookieJar() br.set_cookiejar(cj) ck = cookielib.Cookie(version=0, name='Name', value='1', port=None, port_specified=False, domain='www.example.com', domain_specified=False, domain_initial_dot=False, path='/', path_specified=True, secure

Looking for something similar to Mechanize for .NET... If you don't know what Mechanize is.. http://search.cpan.org/dist/WWW-Mechanize/ I will maintain a list of suggestions here. Anything for browsing/posting/screen scraping (Other than WebRequest and WebBrowser Control). Parsing HTMLAgilityPack - http://www.codeplex.com/htmlagilitypack Web App Testing WatiN - Web Application Testing Framework (.NET) - http://watin.sourceforge.net/ Selenium - http://seleniumhq.org/ Art of Test Design Canvas - Costs Money Tools Firebug for Firefox Internet Explorer Developer Toolbar for IE Chrome has one too

I was wondering if there was anything similar like Mechanize or BeautifulSoup for PHP? Jon SimpleTest provides you with similar functionality: http://www.simpletest.org/en/browser_documentation.html I don't know how powerful BeautifulSoup is, so maybe this won't be as great ; but you could try using DOMDocument::loadHTML : The function parses the HTML contained in the string source . Unlike loading XML, HTML does not have to be well-formed to load. After using this, you should be able to access the HTML document using DOM methods -- including XPath queries. 来源： https://stackoverflow.com