When using
dt.datetime.toordinal
be careful that it only converts dates values and does not take into account minutes, seconds etc.. For a complete answer on generating ordinals from full datetime objects you can use something like:
df['Datetime column'].apply(lambda x: time.mktime(x.timetuple()))