How to get FFmpeg to consistently apply speed effect to first few frames?

Question

I am using FFmpeg to apply speed effects to short gifs and videos and I noticed strange stuttering on looping gifs when sped up. I manually tested and found what was going o