Depends on whether he intends to run in the next election.
If he intends to call it quits then he's entitled to all the privacy that every other private citizen is entitled to, and he doesn't owe any explanations to anyone.
On the other hand, if he wants people to vote for him, then he has to prove to us voters that he is the right man for the job, in order to earn our votes--and they very much are earned, he isn't entitled to re-election. Voters routinely ask a lot of candidates--they demand that tax returns be opened up, they demand accounting for all sorts of personal opinions and beliefs, and a bunch of other stuff that no private citizen would ever be asked. Voters want to know the guy they are electing is of good strong character, honest, trustworthy, etc., and so we ask a lot of questions and we expect answers.
I can't imagine why anyone would believe he is the right man for the job when he's most likely smoking crack. He needs to explain that to us, or no-one will vote for him.