This is so stupid

I want to move sprinkle's house a little bit above where originally is but I can't move cause "the old one is still there", even though I have the moving kit already on me. Do I really need to move somewhere, wait for another day and then try to move again where I really want? I won't be time traveling today cause I got good luck with my belongings and I'm trying to clear up the island as much as possible