I have pem certificate with private key and server certificate. I can execute it using curl and all works ok.
curl -O -k --cert-type pem --cert mypem.pem url
You need to import the certificate in the java trust store.
BTW pem and cer(t) files are the same, just a different name for the extension
Additional links