You could - as you mentioned - just kick off a new thread that sleeps for that number of seconds.
Or you can use one of Windows' multimedia timers (in Python, that'd be in windll.winmm). I believe timeSetEvent is what you're looking for. Incidentally, I found a piece of code that uses it here.