python,keras. Error while building training model : TypeError: 'int' object is not iterable

Question

I am having trouble with my input into my keras training model. The error I am receiving is \'int object is not interable. I am using the openai cartpole simulation from which I