Woody Allen wasn't a father to Soon-Yi. She didn't live with Woody, and Woody didn't have anything to do with her upbringing. Mia Farrow adopted Soon-Yi and acted as mother. Keep in mind that Woody and Farrow didn't live together for the entire course of their relationship. It's a little weird, yes, but we're at an escort review board, right? Not that I have any moral objections to the topic, but if you asked any little old lady on the street they'll probably look at the hobby and Woody Allen's actions the same way.
Woody is my favorite director, but I'm not going to go into a big defense of his work. If you don't see the big deal, then you don't see the big deal, and that's fine. I can understand audiences staying away because his dramas are more european in style and his comedies are very silly (Slipping on the giant banana peel in Sleeper for example). But I have to say that the big black dot in the middle of a white canvas analogy can't apply to his body of work. His themes and the motivations of his characters are very clear, and even though some references may go over our heads because of age or location, they make sense. I don't think there's any ambiguity in what Woody is saying with his films.
Plus, he has averaged a film a year for at least forty years. For that task alone he should get a bit of credit.