Do you love each other or do you love the sex? BIG question to answer but whatever it is END IT AND WALK AWAY for the kids sake as this will get very messy and the kids will suffer and they will end growing up resenting their mother for breaking up the family.