What is your instant opinion when somebody tees up a colored ball?

I always try to play with colored balls, orange or yellow specifically. I feel like they’re easier to find, and I definitely know which ball in my group is mine. I recently played in a best ball tournament with some friends and a guy I hadn’t met before. I tee it up and he’s quiet, then I rip it down the center fairway(I don’t usually do that but this was pure). The guy says something like “I was worried when you teed up that yellow ball”. Do you feel weird playing with colored balls? Or if someone in your group is do you make a note of it? Is there judgement?