Why is it no problem coming back after years? You live offshore, pay little tax, what's the cost of re-entry?
When you leave Canada to live abroad and not be subject to Canadian taxes, you sever your ties to Canada with the intent of not coming back. So if you keep a car, or put your furniture or your clothes in a long-term storage facility in Canada, that indicates an intent to return, thereby making you a resident of Canada while you were away. Just because you were a resident of another country does not necessarily mean you were not a resident of Canada. You can be a resident of both places at the same time if you don't meet Revenue Canada's requirements, thereby getting a huge tax bill on your worldwide income on your return.
You can own a property like a house, but it must not be left empty as this indicates an intent to return to Canada. However, you can own a house and rent it beyond arms length (not to your relatives) for leases of at least 3 months long, as this becomes investment property. You are still allowed to invest in Canada as a non-resident. That means you can have a bank account for that purpose, and you will have to pay tax on that revenue.
You cannot remain in Canada more than 180 days a year, as longer would make you a Canadian resident even if you made all of your money offshore, and be faced with a huge tax bill when you have to file again on your return.
As a non-resident, you don't pay tax while living offshore because you don't use any services the Canadian taxpayer pays for (except consular services). The big chunk is the provincial health insurance plans. That's why you have to turn in your health card. If you then decide to return to Canada after a minimum absence (I think it's 2 years), then you resume paying taxes and benefit from government services again after a 3 month wait.