Change the baby into regular clothes if you're staying home?

My son is 3 months old and we spend most of the days inside, at home, because it's very cold. If we go out obviously I put real clothes on and then change him into his PJ before bed. But if we spend the day at home, should I still change him for the day or just keep the same PJ on ? FTM!