In which cases should tf.Session() and tf.InteractiveSession() be considered for what purpose?
When I tried to use the former one, some fun
On the top of installing itself as default session as per official documentation, from some tests on memory usage, it seems that the interactive session uses the gpu_options.allow_growth = True option - see [using_gpu#allowing_gpu_memory_growth] - while tf.Session() by default allocates the whole GPU memory.