Spark count(“*”).over(window) returning incorrect values (pyspark 2.3)

Question

We have a window specification and a count("*") over that window as follows:

from pyspark.sql.functions import count as spark_count, rank window_spec = Win