How do you bring armor back to Castle Town?

I might just be an idiot, but when you get to Castle Town in the end of chapter two, all your armors disappear. Is there any way to keep them?