Taking the example from: http://docs.djangoproject.com/en/dev/topics/db/aggregation/#filter-and-exclude
Publisher.objects.filter(book__rating__gt=3.0).annota
You can try something like:
Book.objects.values('publisher').annotate(num_books=Count('id'))