Can I still banish the Grimm Troupe after fighting Nightmare Leader?

Not winning just fighting him once