Problem with remember per page setting

I think there is an usability error with the "per page" setting on tables, but maybe its just me. Let's say I have a table with 100k entries. By default you will see 10 rows per page, which is fine. You can optionally change the number of rows per page in the footer of the table (see screenshot). Selecting the option "all" will break the table since it tries to load all 100k entries. Which is expected, so hopefully nobody will do this. Now imagine the following situation: You are activating some filters and reduce the number of rows to lets say 36. Now you select the option "show all rows" and you will see all rows. Perfect. And now click on the sidebar entry. The table/page is broken, since it forgets the filters, but remembers the "per page" setting, so it tries to load 100k entries. Only thing you can do is logout+login again.