Based on the MIME-Type (in your post text/x-vcard) the browser decides weather to open the file inside the browser or to start a download.
One easy way is to tell the server to offer files ending with .vcf with a ohter MIME-type. Here you should select a type where you can be sure that the browser will always download it:
Try: AddType application/octet-stream vcf
