I'm trying real hard to think of a ROMANTIC restaurant in Toronto. Definitely NOT Harbour 60 or Barbarians (IMHO). Definitely NOT Joso's. Definitely NOT the Prince Japanese Steakhouse.
(I've been to all of the above and while decent enough food (except the Prince Japanese Steakhouse - which is just your average sushi joint in Mississauga at best).
Mildred's Temple Kitchen used to encourage their patrons to have sex in their washrooms, but the food is just above average and the venue is like eating in a parking garage. Their old location was much superior. It might be a blast to fuck in their washrooms though....
There are only 3 restaurants that I can think of that might (key word is might) be considered "romantic" by yours truly.
1.
Scaramouche
Old school dining, but something about the place. Probably the view. It's in a whacked out location (like the bottom of a 70's condo), but the view of the city is incredible and the food is excellent.
2.
Sauvignon Bistro
This place is more summer time romantic. I dunno why, (well, I do, I've had a couple of dates start out there that ended up super sexually charged). Anyway, food is excellent, it's a tucked away neighbourhood resto in the beaches that just has a nice feel to it and in the summer, you can head over the boardwalk off of kew gardens and go for a walk along the boardwalk
3.
The Chase
The fifth floor, not the first floor. Sexy furnishings, great view. Food is very good to excellent.
.