HOG is commonly used in object detection schemes. OpenCV has a package for HOG descriptor:
http://docs.opencv.org/modules/gpu/doc/object_detection.html
You can also use BoW based features. Here's a post that explains the method:
http://gilscvblog.wordpress.com/2013/08/23/bag-of-words-models-for-visual-categorization/