Here\'s how I plot the heat map:
sns.heatmap(table, annot=True, fmt=\'g\', annot_kws={\'size\':24})
The thing is, size set only
size