I ended up using the HttpSessionListener and refreshing in an interval larger then setMaxInactiveInterval.
So if the used did nothing for 30 Sec in the next refresh after 40 Sec I get to sessionDestroyed().
Also important that you need to create new ServletContext to get to the ServletContext.
ServletContext servletContext=se.getSession().getServletContext();
Thank you!