Index pandas DataFrame with lists of indices and fill with value

Question

I have two pandas DataFrames. idxs has indices with multiple y values for each x. I also have an 0-filled matrix called mat