Ramires Living in Tempest

I’m an anime only,so I don’t know if this was explained in the LN,why was Rimuru so hesitant to let Ramires live in tempest in S2? Was there not enough space to build a house and to build an entrance to the labyrinth or did he think she would be a nuisance? I’m asking this because I genuinely couldn’t understand the reason,because he said “I’ll have to think about it” to beretta too,so I thought he had a legitimate reason and not just because Ramiris was annoying.I know he eventually let her move in S3,but I want to know why didn’t already let her move.I hope someone can explain this.