Hasn't happened to me and I've seen plenty of SPs. I never have feelings of attachment, just purely sexual feelings. If I see an SP that I really like, I take note of it and make a mental picture of the things I like about her - features, smell, etc. Sometimes I'll see them a few more times in the future, but growing attached just seems so limiting.
Imagine getting hooked on a hot 18 year old. That's all fine and dandy, but tomorrow millions of other hot girls turn 18, and the day after, and the day after that.