HEYHEY, what you don't get is that the tenant is still in lawful possession of the unit. Not you. You aren't entitled too lock him out, and if you try--especially in winter when it is a life safey issue--you are really going to get arrested. Not only that, the tenant is going to sue you, and you're going to lose that suit, and he'll wind up owning the unit anyway.
Just because he failed to pay doesn't mean he's lost possession of the unit. You have to follow proper procedure to regain possession, posting proper notices, going to the tribunal, all that nonsense. And as someone mentioned, they aren't going to allow you to evict someone in January when it's -20 degrees outside unless that person has found somewhere else to go. It won't happen.
Just because you are the landlord doesn't mean it's your property to do with as you see fit--it's rented out to a tenant, and they have legal possession, not you.
And whether you know you have it or not, he DOES have a lease on that unit. There are default lease clauses that are implicitly written in by law that are always assumed to be there. He entered into an agreement with the original tenant, and now he has a lease. You actually have to terminate that lease properly to get him out of there, and no, it doesn't expire -- it will go month to month once any originally agreed term is up.
- - -
As for your claim that you would pretend not to know he's living there when he really is, that's going to fall flat. His stuff is going to be in that unit, he's going to be able to prove that to any officer who shows up by having the door opened and walk around inspecting his belongings. If you put them all out on the curb, then you are tacitly admitting to knowing he was in there -- otherwise, why the hell were you moving his stuff? On top of the charges for the illegal eviction, you're going to get charges for lying to the police, obstructing justice, or whatever, or perhaps even a fraud charge.
- - -
When you say "my house" note that it's different if it actually is YOUR house, as in, YOUR primary residence. If you were renting out a room to him, where you shared the bathroom and kitchen with him and other common areas, then it's not landlord/tenant and you do in fact have the right to kick him to the curb much more quickly. But I gather that this is a stand-alone rental unit, not "your house" and therefore it's under the full tenant protection regime.