Nobody that I know of is saying you are either for us or against us. Most Trump supporter do not think that way. The fact that most (not all) NeverTrumpers are Prius driving, tree hugging, vegan, homosexual, dope smoking, flag burning, Hillary loving, openly declared Communists, is not really the issue. There is nothing wrong with being who you are, whatever that may be.
The only issue is, you have to 'own' it. When the NTs accept themselves without denial, it makes it so much easier for everyone else to accept them for what they are as well.