I used Prometheus to measure business metrics like:
# HELP items_waiting_total Total number of items in a queue # TYPE items_waiting_total gauge items_waitin
It's not advisable to go above about 2 minutes. This is as staleness is 5 minutes by default (which is what's causing the gaps), and you want to allow for a failed scrape.