I wrote a short program main.py using numpy and Qt:
from PyQt5 import QtWidgets
import numpy as np
import sys
if __name__ == \'__main__\':
Have you tried excluding modules? This is a common problem. Also you might want to check out:
Reducing size of pyinstaller exe
Worth mention, are you using Anaconda? A fresh oracle box python system and less of a huge file.
I believe in there docs somewhere you can adjust where the directories are found.
https://pythonhosted.org/PyInstaller/spec-files.html