The problem is once you have fantastic sushi (Kaji = No. 1, Yasu = No. 2), it's real hard to go back to that place on Bloor Street.
But if you want romantic and fantastic, I would give the edge to Yasu because it's a little more intimate. But if you want the best sushi in all of Toronto, arguably Canada, then it's Kaji). But you aren't getting out of either without dropping 300 bucks for 2 people. Still, if it gets you laid, you have to look at, "well, a good SP will run you 300, however, I got this really good sushi dinner on top for free". See, it's all about how you want to look at it.)
Good sushi restaurants + "romantic" ambiance is rare.
I like Nami on Adelaide, they have some candle-lit curtained booths which is fun every now and again.
Or further west on Adelaide is Yuzu No Hana. It's the typical sushi type set up, long rows of tables but the place has a really good vibe with lower level lighting. So you can ask for a table right at the far end and create your own level of intimacy.
Neither rates #1 for sushi in Toronto, but they both offer VERY good fresh quality and won't break the bank.