I heard the following story from a Rosh Yeshiva and I think it accurately sums up a position on this:
There was a bochur in yeshiva who was rigid on that he would only marry/date an extremely attractive girl. He went on and on about this and it was becoming a big issue for him. All the rabbeim in his yeshiva were criticizing him and blasting him for it. Eventually it got to the point where he decided he would go to a Gadol, ask him the question, and follow whatever he said, convinced that he was right. The Rav I heard this from overheard the bochur telling his story & question to the gadol (I don’t fully remember which Gadol this was, although I’m 90% sure it was Rav Kamenetsky, possibly his father) from the next room. Rav Kamenetsky responded that it is important to marry someone he’s attracted to, and expounded on this, building the guy up to think he’s right, and all his rabbeim were wrong on it, at which point Rav Kamenetsky slammed his hand on the table, and said in a rather loud voice “…but you’re sick!!! And you’re going to be miserable!!”