I can :set number from within a file I\'m editing but how can I have them always be on by default?
:set number
If you don't want to add/edit .vimrc, you can start with
vi "+set number" /path/to/file