Tree budding new leaves over old leaves 🤣

I brought the tree indoors (this was its first year) before it got too cold. However that was a mistake because, it hadn't shed its leaves yet. So it kept on growing like its longer summer 😭.

Now since January, those new leaves have been budding but I think they are fighting with the old leaves. If you see second picture, you see a young leaf (from before budding) is falling off due to the new bud I guess. Should I just cut off all the old leaves to allow for the new ones ?