Pointers to structs in vectors and unordered map losing data

Question

I am trying to store data in a vector, which is stored in a struct, which I keep track of using an unordered_map. Unfortunately the lo