Influential political activist says “exclusionary” charge “unfair,” while attacking Carter and Clinton over political views.