hclust size limit?

Question

I\'m new to R. I\'m trying to run hclust() on about 50K items. I have 10 columns to compare and 50K rows of data. When I tried assigning the distance matrix, I get: \"Cannot

Answer 1

The size limit is being set by your hardware and software, and you have not given enough specifics to say much more. On a machine with adequate resources you would not be getting this error. Why not try a 10% sample before diving into the deep end of the pool? Perhaps starting with:

reduced <- full[ sample(1:nrow(full), nrow(full)/10 ) , ]