Nah that’s legit. If you’re going to have a tolerant society, you can’t show that same tolerance to those who are intolerant because they are a threat to the tolerance and will eradicate you. I think it was Karl Popper? To preserve a tolerant society we have to exercise the right to not tolerate the intolerant.