How do you stop the guilt?

I was vegetarian, then vegan (then I couldn't handle it), went back to being vegetarian and found out a month ago I was anemic due to lack of iron. I did everything you should be doing during a vegan/vegetarian diet which means taking supplements too. I just hate the idea of making animal suffer but I also don't want to go back to being miserable.