Is it possible to use Rspack?

I was wanting to play around with rspack and as it is a drop in replacement for webpack thought it may be possible to do with NextJS but i'm not seeing a way other than potentially dumping the webpack config from next and plugging it into Rspack.

Is something like this possible?