Check for Duplicates exists in a dataframe compared to another table using Pyspark

Question

I have a table in Hive as below.

spark.sql("select * from custom_log where custm_id = \'9012457WXR\'").show(100,False)
+----------+---------------------