ffbase

Kriging simulation using ff package

由 空扰寡人 提交于 2020-01-06 04:57:26
问题 I'm trying to understand the way I can use the ff package to overcome the error "Error: cannot allocate vector of size 1.1 Mb" while using kriging/ gaussian simulation. I don't know how to change the input data. Is there any idea to help me do that? I'm using the gstat package to perform the simulation as follows: library(sp) data(meuse) coordinates(meuse) = ~x+y data(meuse.grid) gridded(meuse.grid) = ~x+y m <- vgm(.59, "Sph", 874, .04) # ordinary kriging: x <- krige(log(zinc)~1, meuse, meuse

R ff package ffsave 'zip' not found

由 余生长醉 提交于 2019-12-21 12:11:12
问题 Reproduceable Example: library("ff") m <- matrix(1:12, 3, 4, dimnames=list(c("r1","r2","r3"), c("m1","m2","m3","m4"))) v <- 1:3 ffm <- as.ff(m) ffv <- as.ff(v) d <- data.frame(m, v) ffd <- ffdf(ffm, v=ffv, row.names=row.names(ffm)) ffsave(ffd,file="C:\\Users\\R.wd\\ff\\ffd") ## Error in system(cmd, input = filelist, intern = TRUE) : 'zip' not found System: Windows 7 64bit, R 15.2 64bit Rtools installed zip 300xn-x64 and unzip 600xn folders set to windows Path already cmd line working, type

Functions for creating and reshaping big data in R using the FF package

由 拈花ヽ惹草 提交于 2019-12-19 10:23:14
问题 I'm new to R and the FF package, and am trying to better understand how FF allows users to work with large datasets (>4Gb). I have spent a considerable amount of time trawling the web for tutorials, but the ones I could find generally go over my head. I learn best by doing, so as an exercise, I would like to know how to create a long-format time-series dataset, similar to R's in-built "Indometh" dataset, using arbitrary values. Then I would like to reshape it into wide format. Then I would

How to subset a large data frame (ffdf) in R by date?

由 ▼魔方 西西 提交于 2019-12-12 20:32:53
问题 I am trying to subset an FFDF by a date. Below, I have successfully created such a subset using a normal data frame. But I needed some help in applying this to an FFDF. My attempt, along with the error message, is listed in the code comment. Many Thanks in advance! #Create a normal data frame (in production this is read directly into an ffdf #through a csv file) start <- c("01/01/2010", "01/01/2011", "01/01/2012", "01/01/2012", "01/01/2012") end <- c("31/12/2010", "31/12/2011", "31/12/2012",

Merging and appending ffdf dataframes

由 拟墨画扇 提交于 2019-12-11 04:16:17
问题 I am trying to create an ffdf dataframe by merging and appending two existing ffdf dataframes. The ffdfs have different numbers of columns and different row numbers. I know that merge() performs only inner and left outer joins while ffdfappend() will not allow appending if columns are not identical. I am wondering if anyone has a workaround for this. Either a function like the smartbind() function in the gtools package or any other workaround. Of course converting back to as.data.frame() and

R ffdfappend SIGBUS error

由 你说的曾经没有我的故事 提交于 2019-12-11 03:59:06
问题 I have an R script which uses the ffbase and ff packages. In Windows the script runs fine. In Linux (different box, higher RAM though) it crashes with a bus (SIGBUS) error. Windows (Version 6.1.7601) session info: R version 3.1.0 (2014-04-10) Platform: x86_64-w64-mingw32/x64 (64-bit) attached packages: ffbase_0.11.3 ff_2.2-13 bit_1.1-12 Linux (Linux xenja 3.5.0-54-generic #81~precise1-Ubuntu SMP Tue Jul 15 04:02:22 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux) session info: R version 3.1.1 (2014

R ff package ffsave 'zip' not found

由 こ雲淡風輕ζ 提交于 2019-12-04 04:48:40
Reproduceable Example: library("ff") m <- matrix(1:12, 3, 4, dimnames=list(c("r1","r2","r3"), c("m1","m2","m3","m4"))) v <- 1:3 ffm <- as.ff(m) ffv <- as.ff(v) d <- data.frame(m, v) ffd <- ffdf(ffm, v=ffv, row.names=row.names(ffm)) ffsave(ffd,file="C:\\Users\\R.wd\\ff\\ffd") ## Error in system(cmd, input = filelist, intern = TRUE) : 'zip' not found System: Windows 7 64bit, R 15.2 64bit Rtools installed zip 300xn-x64 and unzip 600xn folders set to windows Path already cmd line working, type zip or unzip it shows function info Need help! Any suggestion is appreciated. It seems your path is not

delete rows ff package

由 走远了吗. 提交于 2019-12-03 14:41:39
问题 Since a while now I´ve been using ff package in order to work with big data. The R object I´ve worked with has about 130.000.000 rows and 14 columns. Two of those columns, Temperature and Precipitation have missing values “NA” so I need to delete those rows in order to move forward with my work. I´ve been trying to do it like I would in a normal R object: data<-data[!is.na(data$temp),] But I keep getting an error: Error: vmode(index) == "integer" is not TRUE Does anyone have been able to

delete rows ff package

由 狂风中的少年 提交于 2019-12-03 03:46:13
Since a while now I´ve been using ff package in order to work with big data. The R object I´ve worked with has about 130.000.000 rows and 14 columns. Two of those columns, Temperature and Precipitation have missing values “NA” so I need to delete those rows in order to move forward with my work. I´ve been trying to do it like I would in a normal R object: data<-data[!is.na(data$temp),] But I keep getting an error: Error: vmode(index) == "integer" is not TRUE Does anyone have been able to delete rows in a ffdf object? I´d appreciate any help. Indexing based on a logical ff_vector is not

ff package write error

由 爷，独闯天下 提交于 2019-12-02 06:07:56
问题 I'm trying to work with a 1909x139352 dataset using R. Since my computer only has 2GB of RAM, the dataset turns out to be too big (500MB) for the conventional methods. So I decided to use the ff package. However, I've been having some troubles. The function read.table.ffdf is unable to read the first chunk of data. It crashes with the next error: txtdata <- read.table.ffdf(file="/directory/myfile.csv", FUN="read.table", header=FALSE, sep=",", colClasses=c("factor",rep("integer",139351)),
订阅 ffbase