How do I optimize an A-frame environment with clickable objects for both desktop and VR?

Question

I have an A-frame scene with clickable objects. If I set the ray origin to the mouse, everything works fine on desktop. Clickable objects respond correctly on every click. H