I had the same problem when using the latest Material Dialogs (0.8.5.6) with the latest Support Library (23.2). Reverting to Material Dialogs 0.8.5.1 with Support Library 23.1.1 works on Android 4.
Bug report on Material Dialog's GitHub: https://github.com/afollestad/material-dialogs/issues/983.