I have a Nexus 4 with Android 4.3 and I am trying to connect the device to a computer with Windows 7 64bit.
I installed the latest drivers and the latest adb>
I think it has an error when the device tries to display the screen asking for permission, so it does not appear.
This works for me (commands are given in the adb shell):
rm /data/misc/adb/adb_keys;stop adbd;cat adbkey.pub >> /data/misc/adb/adb_keys (authorize myself);start adbd (restart adb with new keys).