The only valid point I think he made was that dislike for people who have a different political philosophy is not classical bigotry.
Classical bigotry being hatred of a group for a characteristic such as skin color, ethnicity, sex or age which is impossible or near impossible to change.
A political philosophy defines how a person views how others in a society should be treated. And if you hate the actions of Socialist, Communist or Authoritarians based on their political philosophy you are not exhibiting bigotry exactly. Their philosophy defines how they want you and others to be treated. If we really do believe in freedom he should have every right to hate freedom lovers. Conversely we should have every right to hate his ideology and want nothing to do with him while actively denouncing his political view. A free society should let people have bad political views as long as they have no ability to force those views on others via color of law.