Pandas compare two dataframes and remove what matches in one column

Question

I have two separate pandas dataframes (df1 and df2) which have multiple columns, but only one in common (\'text\').

I would like to do fin

Answer 1

As you asked, you can do this efficiently using isin (without resorting to expensive merges).

>>> df2[~df2.text.isin(df1.text.values)]
C   D   text
0   0.5 2   shot
1   0.3 2   shot