I am following the instruction of this repository with many given examples to build a POMDP model and use their solver for my problem.
Here is my code: