The other answers are fine, though I was looking for a way to get the pointer address as an integer:
let ptr = unsafeAddressOf(obj)
let nullPtr = UnsafePointer(bitPattern: 0)
/// This gets the address of pointer
let address = nullPtr.distanceTo(ptr) // This is Int
Just a little follow-up.