Splitting text to words with R and cSplit()

Question

I\'m trying to split a series of sentences into separate words, that is to tokenize the text.

I have found an R package splitstackshape that is able to

Answer 1

The cSplit function returns a data.table.

What you are describing is the default print behavior for data.tables. To see this in action, try the following:

library(data.table)
as.data.table(airquality)
print(as.data.table(airquality))

print(as.data.table(airquality), nrows = Inf)

Thus, to get the full table displayed, you can try:

library(splitstackshape)
print(cSplit(data, "text", " ", "long"), nrows = Inf)