rselenium

dropdown boxes in RSelenium

人走茶凉 提交于 2019-11-28 07:46:41
How can one interact with dropdown boxes in RSelenium ? In particular, I can select the dropdown box using findElement but how does one select an option with it? B.Mr.W. here is the code to select a drop down list based on xpath. Since the dropdown is inside an iframe, I have to switch into that iframe first. It probably is much easier in your situation. New to RSelenium, check out the quick start tutorial , want to learn more about the function, refer to the pdf documentation . require(RSelenium) remDr <- remoteDriver(remoteServerAddr = "localhost", port = 4444, browserName = "firefox") remDr

Scrape website with R by navigating doPostBack

随声附和 提交于 2019-11-28 04:32:15
问题 I want to extract a table periodicaly from below site. price list changes when clicked building block names(BLOK 16 A, BLOK 16 B, BLOK 16 C, ...) . URL doesn't change, page changes by trigering javascript:__doPostBack('ctl00$ContentPlaceHolder1$DataList2$ctl04$lnk_blok','') I've tried 3 ways after searching google and starckoverflow. what I've tried no 1: this doesn't triger doPostBack event. postForm( "http://www.kentkonut.com.tr/tr/modul/projeler/daire_fiyatlari.aspx?id=44", ctl00

can't execute rsDriver (connection refused)

妖精的绣舞 提交于 2019-11-27 11:44:11
I can't get anywhere with R selenium. Here's the first step and my output: library(RSelenium) rD <- rsDriver() # checking Selenium Server versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # checking chromedriver versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # checking geckodriver versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # checking phantomjs versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # [1] "Connecting to remote server" # Error in checkError(res) : # Undefined error in httr call. httr output:

How to set up rselenium for R?

醉酒当歌 提交于 2019-11-27 09:10:21
"everything was better back then"... since firefox 49 (?) you can't use the rselenium package not straightforward anymore. I have searched the whole internet to find a SIMPLE How To Manual for setting up rselenium but did not find anything relevant and uptodate. Can someone provide me and all the others out there who have no clue a simple How To manual? Like: download XY open AB so I can run code like the following require(RSelenium) remDr <- remoteDriver(remoteServerAddr = "localhost", port = 4444L, browserName = "firefox") remDr$open() Download latest version of RSelenium >= 1.7.1 . Run the

Run RSelenium in parallel

六月ゝ 毕业季﹏ 提交于 2019-11-27 04:35:54
问题 How would i go about running RSelenium in parallel. The following is an example using rvest in parallel library(RSelenium) library(rvest) library(magrittr) library(foreach) library(doParallel) URLsPar <- c("http://www.example.com/", "http://s5.tinypic.com/n392s6_th.jpg", "http://s5.tinypic.com/jl1jex_th.jpg", "http://s6.tinypic.com/16abj1s_th.jpg", "http://s6.tinypic.com/2ymvpqa_th.jpg") (detectCores() - 1) %>% makeCluster %>% registerDoParallel ws <- foreach(x = 1:length(URLsPar), .packages

Using R to “click” a download file button on a webpage

℡╲_俬逩灬. 提交于 2019-11-27 03:30:38
问题 I am attempting to use this webpage http://volcano.si.edu/search_eruption.cfm to scrape data. There are two drop-down boxes that ask for filters of the data. I do not need filtered data, so I leave those blank and continue on to the next page by clicking " Search Eruptions ". What I have noticed, though, is that the resulting table only includes a small amount of columns (only 5) compared to the total amount of columns (total of 24) it should have. However, all 24 columns will be there if you

dropdown boxes in RSelenium

瘦欲@ 提交于 2019-11-27 01:58:10
问题 How can one interact with dropdown boxes in RSelenium ? In particular, I can select the dropdown box using findElement but how does one select an option with it? 回答1: here is the code to select a drop down list based on xpath. Since the dropdown is inside an iframe, I have to switch into that iframe first. It probably is much easier in your situation. New to RSelenium, check out the quick start tutorial, want to learn more about the function, refer to the pdf documentation. require(RSelenium)

session not created: This version of ChromeDriver only supports Chrome version 74 error with ChromeDriver Chrome using Selenium

做~自己de王妃 提交于 2019-11-26 18:57:39
I'm trying to run RSelenium using the rsDriver function, but when I run rD <- rsDriver() I get a message telling me I need a newer version of Chrome: > rD <- rsDriver() checking Selenium Server versions: BEGIN: PREDOWNLOAD BEGIN: DOWNLOAD BEGIN: POSTDOWNLOAD checking chromedriver versions: BEGIN: PREDOWNLOAD BEGIN: DOWNLOAD BEGIN: POSTDOWNLOAD checking geckodriver versions: BEGIN: PREDOWNLOAD BEGIN: DOWNLOAD BEGIN: POSTDOWNLOAD checking phantomjs versions: BEGIN: PREDOWNLOAD BEGIN: DOWNLOAD BEGIN: POSTDOWNLOAD [1] "Connecting to remote server" Selenium message:session not created: This version

stumped on how to scrape the data from this site (using R)

天涯浪子 提交于 2019-11-26 15:57:39
问题 I am trying to scrape the data, using R, from this site: http://www.soccer24.com/kosovo/superliga/results/# I can do the following: library(rvest) doc <- html("http://www.soccer24.com/kosovo/superliga/results/") but am stumped on how to axtually get to the data. This is because the actual data on the website seems to be generated by Javascript. What I can do is html_text(doc) but that gives a long blurp of weird text (which does include the data, but interspersed with odd code and it's not at

can&#39;t execute rsDriver (connection refused)

杀马特。学长 韩版系。学妹 提交于 2019-11-26 15:39:01
问题 I can't get anywhere with R selenium. Here's the first step and my output: library(RSelenium) rD <- rsDriver() # checking Selenium Server versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # checking chromedriver versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # checking geckodriver versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # checking phantomjs versions: # BEGIN: PREDOWNLOAD # BEGIN: DOWNLOAD # BEGIN: POSTDOWNLOAD # [1]