There's been guys I didn't find initially physically attractive who I did later after getting to know them though.I acknowledged that. I said that the looks are the first step per se whereas the person's personality is what keeps you around or makes you unattractive to them.
I don't blame women or men for having physical standards they expect in a partner, but far be it from me to lie and tell someone I'm seeing that I would have approached them even if I was physically unattracted to them.
It can go both ways.