I want to extract frames from a video and apply some filters on it such as gabor/hough etc. Which Java library would be perfect for handling all kinds of video encodings? I have
Xuggler, yes. But if you are going to be working on a lot of Image processing, you should go with OpenImaj. This library uses Xuggler as its dependency, but that's not all what it does. Think of having capabilities of Opencv without the lack of speed which you get in Java. Also, all it requires is adding a maven dependency and you are good to go. The amount of code is also reduced.
Note: I am still reviewing the library and will keep updating my answer on how this goes.
Introductory Video: https://www.youtube.com/watch?v=TNEQ0eNqLgA