I had this same issue. I verified this in postman as follows...
I didn't have to base64 encode my PAT.
I found that I just needed to double check that my PAT had the right access.
I passed the data as Basic Auth.
Username: "whatever the hell you want"
Password: PAT
Response: 200