Keep chosen products when changing filter from price to ratings to most popular

Currently, if I choose some products from the list of highest ratings, if I go looking for other products, such as the cheapest in category or most reviews, my chosen products count goes down to zero, wiping out the products I had added. It would be better if I could use the different filters to choose more products rather than deleting the previous list. thanks!