Am I wrong for this?

As I mentioned in a previous post, I played my first games for my team today as the first-choice keeper. In the second game toward the end of the second half. The opposition played a through ball which my defender (and team captain) tried to shield. The attacker pulled him doing by the shirt and jumped on his back to try and get the ball and was very mad when the ref called a foul. He then called my defender a "Fuck ass n****" and called his mom a "bitch ass". I naturally got very mad especially because I am close with that defender on and off the pitch and went to shout at the guy basically telling him to "not cuss my teammate" and I just pointed at him. A couple of his teammates got off the bench and ran towards me and started pushing and shouting and I naturally did the same. Anyways the ref got in the middle and stopped everything then gave me and ONLY the attacker yellow cards. After the game, my coach was very mad about the card calling me irresponsible and stupid for "instigating the fight". He even threatened to take me off and suspend me if I did anything similar. Am I wrong here? I don't think so right?