I haven't told anyone, and I don't know what I would say if someone asked... it would depend on the person.
I don't really care what "society" thinks of the hobby - I generally have a more sophisticated view of life than the vast majority of people I meet, and I don't happen to think there is anything immoral about the kind of hobbying I do. It is a totally consensual thing, everyone involved is fully apprised of the situation, and is free to say NO at any point to any behavior I might exhibit or suggest. For me it is about engaging in an appreciation of beauty and pleasure in an atmosphere of mutual respect. And I do respect these women, some of them are among the most interesting and talented people I have ever met.
I don't do monogamy, and I don't want a nuclear family. Normals find this unsettling, so I don't bother them by telling them what I do. I am happy to talk about this stuff in a general way with anyone who brings it up, but I don't volunteer any personal info. I don't talk about sexuality in anything other than a general way as a rule, and I especially don't talk particulars about encounters as it just seems like bragging or tattling... I don't need the boost some people seem to get from blabbing about their experiences.
I enjoy the general anonymity of big city life - I have no family in the city, I don't want to know my neighbors, I make friends around my real interests, and not based on the fact that they work with me or live near me. I am happy to get along, but I really don't care what any of these people think.
It is possible (or perhaps probable) that some of my neighbors know that I receive female visitors that they would consider rather more exotic than they expect, based on who I appear to be. That doesn't matter to me, because they are unimportant to my life. If any neighbor made any comments, I'd strongly suggest they stay out of my business, lest I start poking around theirs.
Who would I tell? Anyone who I decided I wanted to have a very close continuing sexual relationship with - probably not right up front, but certainly before we dropped the safe sex routine.
One of the things I enjoy in my hobbying is discussing the pleasure/business with the women I engage for play. Often they have insights and experiences that are enlightening, and I find that I have a lot in common with many of them, in terms of their open attitude to social mores, and a generally experimental approach to life. I learn plenty from them.
I think the normals have two basic attitudes: live and let live, or do as I do or I call you bad names. Live and let live folks, I can live with them. Moralizing assholes who don't want me to do things that frighten them, they can be frightened. Fuck em.