Best practices for retrieving status information from a web scraper process

Question

Are there best practices for communicating status information from a web scraper (written in python) running as an independent process? I have several scrapers running, each as