The primary purpose of a WHERE clause is to limit the rows returned by the query. See SELECT Syntax.
Primary key/Foreign key relationships maintain referential integrity and with proper indexing increase the performance of queries. (See Pete OHanlon's explanation, above and JOIN Types)