It seems to me that I have to retrieve an object before I delete it with entity framework like below
var customer = context.Customers.First(c => c.Id == 1
A smaller version (when compared to previous ones):
var customer = context.Find(id); context.Delete(customer); context.SaveChanges();