Okay, well I've read through the conversations myself and It looks like he is just trying to bait you about it to get a response. as WZ said, don't feed them. Yeah sure he might be bringing it up all the time but just ignore him and if he confronts you directly about it then there's two things. He's pathetic for resorting to that in the first place, and if he goes to that length just to annoy you and try to argue, then regardless of how long you've known him, drop it like it's hot. Or just say 'whatever mate' and just be nonchalant about the situation.
Thin Skin may be a part of it. but that's not your fault, there are a lot of people who feel strongly about furry or other cultures. and they would've done just the same, if not for my experience of dealing with trolls I would've done the same as you.
Oh and if he still persists, then he probably thinks he has unbeatable logic, so one easy thing to do is just crush his pride, turn the argument back on him using the same twisted logic as him. and THEN when he's on the back foot can you pelt him with truths about the fandom. Only speak good things if you wish to best him. and make sure you can back it up in triplicate. then what I would do from there is end on a comment about how pathetic he is for doing all this in the first place, and that if this is his form of entertainment it is really sad and he should probably do something productive and stop being a waste of space...but that's just me.