Database or data structure to efficiently find nearest neighbor with certain conditions

Question

I have around 500,000 32 dimensional vectors (normalized with mean=0, std=1) that I currently store in a KD tree to efficiently find the nearest neighbor. However, now I als