I tried to deploy a very simple site for a Firebase project I have set up, and followed the following steps:
Found my answer in another post
It seems that when deploying, you're supposed to deploy with:
firebase deploy --project [PROJECT ID, not PROJECT NAME]