any ideas on how to compare two columns from two different dataframes using regex in pyspark

Question

I have a dataframe DF1 which has two columns (FileName_Regex and FileID) I have a requirement to get FileID for FileNames (column) in one dataframe2 DF2.

I have to us