How to enable pagination to work if Filter results are more than the specified records in page

Question

I have implemented Filter and Pagination together in the same view class and per page, I am displaying 50 records and without performing any filter operation if I will click