I am referring to How can you concatenate two huge files with very little spare disk space?
I\'m in the midst of implementing the following:
If you can work with ASCII lines and not bytes, then removing the first n lines of a file is easy. For example to remove the first 100 lines:
sed -i 1,100d /path/to/file