If you really want it to be romantic, you have to factor in who you're bringing. I agree Niagara-On-The-Lake is a really good bet, but if your partner isn't into wine, antiques, etc. it won't be that much fun for them.
If they're into art, try Ottawa. If they're an active person, Ottawa is a...