I have a SQL table BookChapters with over 20 millions rows. It has a clustered primary key (bookChapterID) and doesn\'t have any other keys or indexes. It takes miliseconds
try this if you only want to know rows count:
exec sp_spaceused [TABLE_NAME]