sex with the same person can become boring, therefore its the novelty value of having sex with different women that attracts you.
Further different people have different sex drives, controlled by the hormone levels in the body. So the cure really is imposing self control, which is easier said than done.
I think its your spending levels that you have to consider, what else the money could be used for rather than visiting sex places.
For example limit your visits to once in two weeks, then decide how much money you can afford to spend and only take that amount into the establishment leave your wallet in the car.
Could continue, with how I control my habits, which I find do work.
Finally let me say, it is a road to financial ruin if you don't control it.