I officiated high school for over 20 yrs and I knew a few officials that worked D-1 college games. The Hampton family that officiates in the SEC are long time acquaintances.
Officials are human and different. I worked with one really good official, but he was really biased sometimes. I refused to work with him after a few years. As Katwatcher said, judgement calls are hard to make at the blink of an eye. What really pisses me off about an official are "make up" calls and assuming a foul underneath before the play is even finished.
Officials are graded, but unless it's a flagrant or a significant amount of bad calls, the season schedule won't change for the official. Where the grades come into play is when the supervisors start assigning tournament games. Theoretically, only the highest rated officials gets the higher rated games, although in HS, it could come down to how big of a buddy you are with the assigning secretary. I'm sure it happens, to some extent, at every level.
Now having said all that, I still yell at the officials through the TV when I think they screw up.