I'm not sure, but I'd hardly think someone would do something like moving to NY just to get away from you. People form their own paths and paths go many directions. Having said that, I don't think anyone likes a feeling of abandonment. That's rough your dad did that and couldn't handle the heat.
"What is it about me that doesn’t inspire men to stay?" - I was going to joke it's because you only sleep with straight men, but I won't :P I think you just need someone as intelligent as you are who can hold a conversation about basically anything. Someone like that will gladly stay around you.