As per the comment under this answer, references were introduced primarily to support operator overloading which quotes Bjarne Stroustrup:
References
Operator overloading work on objects but pointer is not an object by itself. It points to an object.