NLP: Building (small) corpora, or “Where to get lots of not-too-specialized English-language text files?”

Question

Does anyone have a suggestion for where to find archives or collections of everyday English text for use in a small corpus? I have been using Gutenberg Project books for a

Answer 1

If you're willing to pay money, you should check out the data available at the Linguistic Data Consortium, such as the Penn Treebank.