Does CUDA support recursion?
Yes, see the NVIDIA CUDA Programming Guide:
device functions only support recursion in device code compiled for devices of compute capability 2.0.
You need a Fermi card to use them.