For anyone struggling with this problem I have written a component react-big-list that handles lists to up to 1 million of records.
On top of that it comes with some fancy extra features like:
- Sorting
- Caching
- Custom filtering
- ...
We are using it in production in quite some apps and it works great.