So far I saw methods to get multiple phone numbers if I show a picker so user can select people and then get the phone number.
What I want is retrieving all contacts
Sure you can. First you'll need to get the user permission for doing so. If you won't the user will have to manually authorize your app from the settings. There's a great example on how to retrieve all phone numbers, names, addresses etc' here.