faster deleting/masking few entries from a large index array

Question

I have an index manipulation problem that I can solve, but it\'s slow. I\'m looking for a way to speed this up.

I have a large (m, 2) float array (think