edit: Scaling the input data only made it worse. I realized though, that I had to use a bigger batch size, that made it already look much better. And I made