ValueError: cannot reshape array of size 1 into shape (1,4)

Question

Commenting out the offending code also gives me this error: AssertionError: Cannot call env.step() before calling reset()

Trying to follow along a tutori