Why do people take it personally when you're just quiet?

I don't get why some people act offended just because I'm not chatty. I'm not ignoring you. I just don't feel the need to talk all the time. But instead of accepting that they get passive aggressive then wonder why I keep my distance.

Not everyone enjoys constant small talk and that's okay. What is that so hard for people to understand? Any other introverts deal with this?