I don't know why Woody Allen keeps getting lumped into these groupings with pedophiles. Unlike most pedophiles, he has only ever been accused exactly once, an accusation mediated by his ex who had found out about Allen's relationship with her adopted daughter Soon-Yi only months earlier. Allen was thoroughly investigated by two different agencies, both of which found no credible evidence of sexual assault or abuse.
I am not really a fan of the man, but if I had to guess he was just the high profile case. Sometimes remembering all of the fall out is harder as it is not in the press as much as the initial anger etc.