I had this same problem dealing with NHibernate entities and I found quite simple solution to it.
You should initialize the Details property in the ItemViewModel constructor. This way the destination value is not null ever. Of course this does not work in more complex cases (like abstract classes).