Optimize/Vectorize Database Query with R
问题 I am attempting to use R to query a large database. Due to the size of the database, I have written the query to fetch 100 rows at a time My code looks something like: library(RJDBC) library(DBI) library(tidyverse) options(java.parameters = "-Xmx8000m") drv<-JDBC("driver name", "driver path.jar") conn<- dbConnect( drv, "database info", "username", "password" ) query<-"SELECT * FROM some_table" hc<-tibble() res<-dbSendQuery(conn,query) repeat{ chunk<-dbFetch(res,100) if(nrow(chunk)==0){break}