For me personally, it's knowing that if UK had a player involved in any of the things that have gone on at Duke (jewelry and Magette sp?), UNC (30+ years of academic fraud), UofL(stripping 101) or even all the allegations that have occurred at Kansas this year, we'd be hit with sanctions within weeks and they'd be hefty penalties.
I probably wouldn't care as much if all schools were treated equally. We have Cal who has been deemed a cheater because of a player he self reported and another player that they never proved did anything wrong. We can't even celebrate a 500th win without the NCAA catching wind of it and making sure to crash the party.
Yet all the above can happen at other top schools (specifically UNC and Duke, as UofL will hopefully get smacked) and not a thing happens. You can have a pile of evidence (see UNC) and not have a thing happen.
Add in the fact that we always, always, always have a tough reigion. Granted I'll give you Kansas gets tougher regions as well. But watching what Duke and UNC get...
That for me is a big reason I despise some of the other schools.