I don't see how you can consider Wicked not a swinger club - only couples go there, and on occasion they have sex with other couples. To me, that makes it a swinger club. That does not mean it is for everyone, half the time when we go there we have a great time, the other half we swear that we will never go back. We prefer Abstract and X Club to Wicked, other than the fact that you can have sex at Wicked.
If anything, I think that Toronto has fewer swinger clubs than it should, given the population and Canada's liberal attitudes towards sex. Toronto has one on-premises club, that is open two nights a week, and a number of off-premises clubs, none of which are open more than two, or perhaps three nights a week.
New York City, Las Vegas, Miami, San Francisco and Los Angeles all have multiple on-premises clubs, some of which are open five or more days and night per week. I do not understand why Toronto could not support that level of activity.