I have a simple pandas pyinstaller exe which is over 40MB.
My exe example:
import collections import csv import selenium import pandas print(\'hi\')
The python interpreter and all imported modules are included in the executable.
You can try adding modules you want to exclude to the excludes list under Analysis in your spec file.
excludes
Analysis
You could also try compressing the executable using UPX. See A note on using UPX