I\'m using SQL Server 2012, and I have a database with a SQL_Latin1_General_CP1_CI_AS collation:
create table testtable (c nvarchar(1) null)
i
The collation is not BINARY. It is CI case insensitive, so it will fold upper and lowercase characters to sort the same. It defines the sort order of punctuation and digits in a non-ASCII way as you have discovered. It is a SQL collation, doing what SQL collations do: define the sort order according to some particular rules.