It wont be easy to find, but there are gray hats. And for yechidei segula, there are Western fedoras that come in just about every color. A quality westeren is certainly a hiddur in malbush shabbos and tefillah. Dont know how it would work with tefillin though.
Menu