I have a nodejs data app which gathers data form a remote api and it takes about a week to get the complete current data set.
The data arrives over a websocket and ev