Another concern of the modern orthodox is that the hat will be blown away by a strong wind (happens all the time) and will cause the carrying of the hat in reshus harabim.
Also, what happens to the requirement of hat when using a tallis for davining in the morning? Do we also see a king with a tallis over our heads?
Let the terutzim role in!