scrape

I want to scrape a table like this http://www.oddsportal.com//hockey/usa/nhl/carolina-hurricanes-ottawa-senators-80YZhBGC/ I'd want to scrape the bookmakers and the odds. The problem is I don't know what kind of a table that is nor how to scrape it. These threads might be able to help me ( Scraping javascript with R or What type of HTML table is this and what type of webscraping techniques can you use? ) but I'd appreciate if someone could point me in the right direction or better yet give instructions here. So what kind of a table is that odds table, is it possible to scrape it with R and if

Im trying to parse a list of video game titles from a shopping site. however as the item list is all stored inside a tag . This section of the documentation supposedly explains how to parse only part of the document but i cant work it out. my code: from BeautifulSoup import BeautifulSoup import urllib import re url = "Some Shopping Site" html = urllib.urlopen(url).read() soup = BeautifulSoup(html) for a in soup.findAll('a',{'title':re.compile('.+') }): print a.string at present is prints the string inside any tag that has a not empty title reference. but it is also priting the items in the

<h3> <a href="article.jsp?tp=&arnumber=16"> Granular computing based <span class="snippet">data</span> <span class="snippet">mining</span> in the views of rough set and fuzzy set </a> </h3> Using Python I want to get the values from the anchor tag which should be Granular computing based data mining in the views of rough set and fuzzy set I tried using lxml parser = etree.HTMLParser() tree = etree.parse(StringIO.StringIO(html), parser) xpath1 = "//h3/a/child::text() | //h3/a/span/child::text()" rawResponse = tree.xpath(xpath1) print rawResponse and getting the following output ['\r\n\t\t','\r

Image http://i.imgur.com/OigSBjF.png import requests from bs4 import BeautifulSoup r = requests.get("xxxxxxxxx") soup = BeautifulSoup(r.content) for link in links: if "http" in link.get('src'): print link.get('src') I get the printed URL but don't know how to work with it. Padraic Cunningham You need to download and write to disk: import requests from os.path import basename r = requests.get("xxx") soup = BeautifulSoup(r.content) for link in links: if "http" in link.get('src'): lnk = link.get('src') with open(basename(lnk), "wb") as f: f.write(requests.get(lnk).content) You can also use a

I want to programatically find a list of URLs for similar images given an image URL. I can't find any free image search APIs so I'm trying to do this by scraping Google's Search by Image . If I have an image URL, say http://i.imgur.com/oLmwq.png , then navigating to https://www.google.com/searchbyimage?&image_url=http://i.imgur.com/oLmwq.png gives related images and info. How do I get jsdom.env to produce the HTML your browser gets from the above URL? Here's what I've tried ( CoffeeScript ): jsdom = require 'jsdom' url = 'https://www.google.com/searchbyimage?&image_url=http://i.imgur.com/oLmwq