I never find accusations of geekishness (which do not relate to my magic and I don't find it a barrier) to be a problem. Really, what can they do?
You're such a geek!
Yes? Did you want something? Oh, you're just applying some abstract label to me. Ok, that's cool. :scratchhead:
Here's the thing. If you're a geek who stands alone in a corner doing XCM, that makes you a bigger geek. "Too much time alone in his room! Should get a girlfriend!"
If you can entertain a crowd, throwing out jokes, teasing people a little* , and also demonstrating something clearly totally off-the-wall impossible, you will be respected as someone with people skills, a good laugh.

less geeky
*Never tease someone's intellect: TRUST ME! If you are performing in an environment where it's ok to poke fun at your audience, never suggest they are slow or stupid. This is what people hate about magicians, the inferiority complex they get when someone fools them because they know a secret. Specs can resent secrets. They won't resent skill in the same way.