“A jacket is an entire appearance, whereas a tie is a minor thing-it doesn’t add/detract from looking respectable as much as a jacket.”
Lets see how this flies on a date. Ever see a bachur show up on a 1st date with no tie? Why should davening be different?