Empress Hotel in Victoria... Bit of a hike for tea, but there's a really good chocolate place just down the street too....
http://www.fairmont.com/empress/GuestServices/Restaurants/AfternoonTea.htm
http://www.fairmont.com/empress/GuestServices/Restaurants/AfternoonTea.htm