How is it really any different than sports with referees/umpires who have to make judgement calls on rules violations? I mean, some things are cut and dried (like offsides in most sports), some things should be but aren't (like baseball's strike zone, or basketball's traveling), and then others are really just up in the air (certain instances of football pass interference or impeding an opponent in soccer). There's also soccer's lack of a timekeeper and the random lengths that referees will extend the game. And mistaken calls from officials in all sports, from mistakes to unobserved rule infringement.

Honestly, I agree with you. The things I mention are largely vagaries, rather than the institutional subjectiveness of figure skating. But they can and do have effects on final scores, even if the ball entering a goal area is straightforward.