Don't Delete the file if exists (because the files will be overwritten) or instantiate innerFile again.
if (innerFile.exists()) {
Log.d("DEBUG",
"The Entry already exits!, so deleting..");
innerFile.delete();
}
//Instantiate Again
innerFile = new File(innerFileName);
Deleting innerFile you lose the file and when trying to create directory using innerFile causes the FileNotFoundException.