I keep my SU! sets in their respective containers (BTW ITA with wanting to 86 the extra space). I keep them in my kitchen hutch grouped by the size of the container. I have started a master log of my stamps in a binder so I don't have to crawl on the floor to find what I need AND my friends can come "browse" my collection without me having to make a mess pulling everything out of the cupboard.
I inherited my friend's stamp shelf that she bought off Ebay for my loose stamps (she can't put nails in her new rental). I think she got it Buy It Now for around $50. It's probably 3 1/2 ft x 4 ft and has adjustable shelves. It's the greatest place to store my ink refillers out of the reach of little hands. I don't have room for the caddy and my kids would make a mess of them.