If the answer is anything other than a resounding "yes," stop reading now because you do not exist.
Now, you may go to an office for your job. If you don't go to an office, you probably go to some "place" to do a job. (Even someone self-employed has to go somewhere, even in the house, to do their job.) Do you know where people involved with sports go when they go to the office?
It may be described in a number of ways: the field, the stadium, the park, etc. It all means the same thing. But if you're a professional athlete or official, your office is literally the playing field.
So if a star athlete has a poor performance, is it not fair to say he or she had a bad day at the office? Does that give others the right to boo that athlete and make sure he or she knows that fans disapprove of their performance?
Let's put it another way: if you're having a bad day at the office, how would you feel if people who didn't work at your office came into your office and just verbally abused you over the job you were doing?
If the answer is anything other than a resounding "bad," stop reading now because you do not exist.
The next time you're not happy with a player or an official at any level in any capacity, keep one thing in mind: that person is trying very hard to do their best. Your negative critique isn't helping and serves no purpose.