I hash my inserted passwords via password_hash. I verify them by using password_verify.
However when I insert a hashed password in my database and I try to verify it
You rehashed the password - just pass the plaintext password and your hash (from db) to password_verify and it works.