Yes it is possible to have any view as the sliding part of a drawer layout. I prefer declaring a FrameLayout as the drawer and replacing it with my fragment, and it runs just fine.
The error you are getting is probably due to some other reason in the Java part of your implementation.