I've been able to get this working:
import pytz
import datetime
tz = pytz.timezone('Europe/London')
print datetime.datetime.now(tz)
It appears Google App Engine already imports a few modules by default, including pytz and datetime, so perhaps there is no need to explicitly import them.