Update
After a bit of investigating. What seems to be the issue is that the SelectedValue/SelectedItem is occurring before the Item source is finis
Setting IsSynchronizedWithCurrentItem="True" worked for me!
IsSynchronizedWithCurrentItem="True"