Is it possible to create a PHP file that runs once with no errors and deletes itself?
If you can't use unlink() try create .htaccess
Deny from all