Another way to know if the file (or files) exists, and to remove it, is using the module glob.
from glob import glob
import os
for filename in glob("*.csv"):
os.remove(filename)
Glob finds all the files that could select the pattern with a *nix wildcard, and loops the list.