rvest

The following link contains the results of the marathon of Paris: http://www.schneiderelectricparismarathon.com/us/the-race/results/results-marathon . I want to scrape these results, but the information lies within a frame. I know the basics of scraping with Rvest and Rselenium, but I am clueless on how to retrieve the data within such a frame. To get an idea, one of the things I tried was: url = "http://www.schneiderelectricparismarathon.com/us/the-race/results/results-marathon" site = read_html(url) ParisResults = site %>% html_node("iframe") %>% html_table() ParisResults = as.data.frame

So I'm trying to make a data table of some information on a website. This is what I've done so far. library(rvest) url <- 'https://uws-community.symplicity.com/index.php?s=student_group' page <- html_session(url) name_nodes <- html_nodes(page,".grpl-name a") name_text <- html_text(name_nodes) df <- data.frame(matrix(unlist(name_text)), stringsAsFactors = FALSE) library(tidyverse) df <- df %>% mutate(id = row_number()) desc_nodes <- html_nodes(page, ".grpl-purpose") desc_text <- html_text(desc_nodes) df <- left_join(df, data.frame(matrix(unlist(desc_text)), stringsAsFactors = FALSE) %>% mutate

I would like to apply a loop to scrape data from multiple webpages in R. I am able to scrape the data for one webpage, however when I attempt to use a loop for multiple pages, I get a frustrating error. I have spent hours tinkering, to no avail. Any help would be greatly appreciated!!! This works: ########################### # GET COUNTRY DATA ########################### library("rvest") site <- paste("http://www.countryreports.org/country/","Norway",".htm", sep="") site <- html(site) stats<- data.frame(names =site %>% html_nodes(xpath="//*/td[1]") %>% html_text() , facts =site %>% html_nodes

I want to grab some data from Pro Football Reference website using the rvest package. First, let's grab results for all games played in 2015 from this url http://www.pro-football-reference.com/years/2015/games.htm library("rvest") library("dplyr") #grab table info url <- "http://www.pro-football-reference.com/years/2015/games.htm" urlHtml <- url %>% read_html() dat <- urlHtml %>% html_table(header=TRUE) %>% .[[1]] %>% as_data_frame() Is that how you would have done it? :) dat could be cleaned up a bit. Two of the variables seem to have blanks for names. Plus the header row is repeated between

I'm trying out the "new" Rvest package from Hadley Wickham. I've used it in the past, so I'd expected that everything run smoothly. However, I keep seen this error: > TV_Audio_Video_Marca <- read_html(page_source[[1]], encoding = "ISO-8859-1") Error: Input is not proper UTF-8, indicate encoding ! Bytes: 0xCD 0x20 0x53 0x2E [9] As you see in the code, I've use encoding: ISO-8859-1 . Before that I was using "UTF-8", but function guess_encoding(page_source[[1]]) says that the encoding is: ISO-8859-1 . I've tried with all the options provided by guess_encoding but none worked. What is the problem?

I'm trying to automate the shibboleth-based login process for the UK Data Service in R. One can sign up for an account to login here . A previous attempt to automate this process is found in this question, automating the login to the uk data service website in R with RCurl or httr . I thought the excellent answers to this question, how to authenticate a shibboleth multi-hostname website with httr in R , were going to get me there, but I've run into a wall. And, yes, RSelenium provides an alternative— which I've actually tried —but my experience with RSelenium is that it is always flaking out