It's definitely caching. On the server side if you have caching enabled, do not wonder if caching happens. You can turn this off in core.php, or more likely clear the cache Cache::clear() when you upgrade your app. On the client side you might want to tweak your browser to disable caching fully.