Worst case, you'll have to delete the folder and recreate as a java package.
- Save the Java classes somewhere else in your Java project by refactoring
- Delete the folder and the underlying folder structure
- Create a Java package
- Move the Java classes back under the Java package by refactoring