He didn't have a point. He sucks as a basketball coach - this is factual with almost two years of evidence to support it. When he's criticized, to call out the criticism as coming from a Trump supporter reeks of racism. Trump's got nothing to do with it. His color has got nothing to do with it.
If he had given an honest answer, like, "the transition to running a college program hasn't been as seamless as I expected it to be, but we have a lot of guys who understand the game and we're going to keep working and getting better," that would have been appropriate. That didn't happen here. Whether he perceived the question as fair or not (and when is the last time the media ever cared about being fair anyway?), he should have handled himself better than he did.