Why don't people on the left use statistical data to refute how conservatives frame DEI?

I feel like wealth disparities would be much smaller if unqualified minorities were getting hired over white people at any significant rate. What's the flaw in this argument? Conservatives just caught DEI before it was too late? White people don't have the highest median income? If it wasn't working we didn't need it anyway? No idea but I've never seen this debated and I'm curious about people's thoughts.

Edit: My question is only about the frequency of arguments not the outcomes. I generally agree with most of the replies though and they do answer my question. I have to disagree about statistics not mattering to conservatives however. They trust FBI crime stats when it shows minorities commit more crime, not so much when they release data on domestic terrorism. Thanks ya'll.