No, in either way, people who care will ask, where is your hat or they don’t know and their won’t be an embarassment. As according to the Baer
Hetev above you are not mechuyav to spend any money on a minyan but not gaining money might be different.
Menu