R memory management advice (caret, model matrices, data frames)

Question

I\'m running out of memory on a normal 8GB server working with a fairly small dataset in a machine learning context:

> dim(basetrainf) # this is a dataframe
[1] 5         


        

Answer 1

You can try to use the ff package, which implements "memory-efficient storage of large data on disk and fast access functions".