Firestore delete / set not working after phone screen is off / locked

Question

I have two simple buttons. One is add to cart, the other is remove from cart. I am also using Provider to keep track of the quantity for each product. Everything is working