$1 million will buy you a detached home in a nice area in Toronto, but homes $2 million and up are better suited for a rich person. At that price you get size and all the modern amenities for a decked out pad in a great area. You get that "wow" factor... you know you've stepped into a house owned by somebody with money.
This is just the house, without the cars, vacations, boats, cottage, and mouths to feed.
With 20% down payment at 3% interest you're looking at around $7600/month in mortgage. Add in property taxes, maintenance/repairs, heat, hydro, tv, phone, and you need around $10k/month to live in your home.
You already need $120k/year just to carry all of that.
Feeding and dressing a family of four in the best designer clothes, sending your kids to private schools, golf yacht and other high end club memberships, regular vacations and dinners for your family, at least 3 high end vehicles and repairs/maintenance on them, gas, insurance, I'd say you're looking at another $10k/month.
That's about $240k/year needed.
Drop another $100k on that for good measure (for cottage and cottage toys like 4x4, boat, etc), and I think you can hold all of that down without headaches or worries. So the minimum I think to be "rich" would be around $350k/year.
Note: this doesn't take into consideration taxes taken off the person's salary and doesn't take into consideration an addiction to hobbying which should run a rich person $2k - $4k per month.
So let's round up to $500k and you're rich with no financial worries and live a dream life.