It seems like there are lots of free Delphi AES implementations. Feel free to add your favourites here.
There don't seem to be as many free RSA implementations, and very few libraries that offer both.
It looks like LockBox is still a pretty reasonable option. Especially since I don't need encryption that will take literally years to crack.
I think using Microsoft's Crypto API directly might be the most practical option.