I am relatively new to all this low level stuff,assembly language.. and want to learn more detail. Why there is a difference between Linux, Windows Assembly languages?
OS dictates its Application Binary Interface (ABI), which includes format of executable objects. These are Executable and Linkable Format (ELF) for Linux (and many other Unix-like systems), and Portable Executable (PE) on Windows. See this table for other formats.