Maybe the frequency is the problem, like with all vices. Why not try once every 2-3 weeks instead of quitting cold turkey?
When the singing group N.W.A. did the song lyrics Life ain’t nothing but bitches and money, they were criticized. But scholars pointed out that some ancient Greek philosophers had analyzed male life the same way.
While the nature of life is that bitches can only be obtained if sufficient current money exists (or potential future money for the very young male), life cannot be enjoyed if all money is spent on bitches.
An additional factor is that you don’t get to take money with you when you die, and even if you could, no major religion includes the promise of a brothel in the afterlife. Plus as others have pointed out, the ability to perform sexually declines as the male ages.
So there is some proper balance for everyone, depending on asset accumulation, current income, relative enjoyment on items purchased other than sex, and life expectancy. No one will ever get it perfect. But I am skeptical that completely eliminating the purchase of commercial sex from the equation would ever be the key to greater happiness, unless the needs are satisfied through a civilian relationship (which of course takes some of the money). I suppose a practical problem is that the higher costs of purchasing quality sex in recent years, coupled with the increased cost of other things, has locked out many purchasers whose income and asset growth has not kept up with inflation. I don’t think those people are happier as a result of giving up the purchase of commercial sex, they are just less unhappy than they would be otherwise. The key, unfortunately, is probably for them to earn more money.