Over 1000 games, calls even out. Just like shooting percentages average out over 100s of shots. But in a given game, if a shooter has a bad night it can easily swing the outcome... just like if an official has a bad night.
It's like saying "injuries are part of the game"... that's true, but if your star player goes down in the first half, that dramatically changes the likelihood of you winning. At a macro level over 1000s of games and 100s of teams, injuries also even out.... but to a given team on a given night, they can mean the difference between winning and losing. Bad officiating is also part of the game, and you have to live with it (or overcome it).
I'm more concerned about the style of officiating, though.... is the game being called loose or tight, is incidental contact being let go or are ticky tack things getting whistled? Defensive-minded man-to-man teams (like us) tend to do better in the former scenario, and struggle in the latter.... wholly putting aside the "good call/bad call" arguments.