rvest

Here's my reproducible example: library(rvest) page <- html("http://google.com") class(page) page > as.character(page) Error in as.vector(x, "character") : cannot coerce type 'externalptr' to vector of type 'character' How can I convert page from an html class to a character vector so I can store it somewhere? The html functions like html_text or html_attr don't give me the whole source. I would like to store it so I can later re-load it with html(). Thanks. To save directly to a text file: capture.output(page, file="file.html") To store as a string: htmltxt <- paste(capture.output(page, file

I would like to scrape some table data from Wikipedia. Some of the table columns include links to other articles I'd like to preserve. I've tried this approach , which didn't preserve the URLs. Looking at the html_table() function description, I didn't find any options of including those. Is there another package or way to do this? library("rvest") url <- "http://en.wikipedia.org/wiki/List_of_The_Simpsons_episodes" simp <- url %>% html() %>% html_nodes(xpath='//*[@id="mw-content-text"]/table[3]') %>% html_table() simp <- simp[[1]] Try this library(XML) library(httr) url <- "http://en.wikipedia

I'm trying to grab a table of data using read_html from the r package rvest. I've tried the below code: library(rvest) raw <- read_html("https://demanda.ree.es/movil/peninsula/demanda/tablas/2016-01-02/2") I don't believe the above pulled the data from the table, since I see 'raw' is a list of 2: 'node:<externalptr>' and 'doc:<externalptr>' I've tried grabbing the xpath too: html_nodes(raw,xpath = '//*[(@id = "tabla_generacion")]//*[contains(concat( " ", @class, " " ), concat( " ", "ng-scope", " " ))]') Any advice on what to try next? Thanks. This website is using angular to make a call to get

I've searched around stackoverflow and github but haven't seen a solution to this one. session <- read_html("http://www.whitepages.com") form1 <- html_form(session)[[1]] form2 <- set_values(form1, who = "john smith") submit_form(session, form) After the submit form line, I get the following: Submitting with '<unnamed>' Error: not compatible with STRSXP I've pieced together that this error is usually from mismatched types (strings and numeric, for example), but I can't tell where that might be happening. Any help would be greatly appreciated! I just had this problem myself, and I found that the