Who cares? Just because you go over to someone's house does NOT mean you want to have sex.I'm not sure why men think this way.
If you're unsure then take time to survey men and find out "why"
But I believe we're all pretty clear that men DO think like this.
SOHH even though you can't understand WHY, just work with and around the fact that we DO (think that way).
In short, if you not feeling dude like that, do not go to his house. In the middle of the night. And keep coming back. After he rapes you.
So cut it out, then we'll worry about 'why' men think this.