Just for arguments sake, I believe the gemara discusses the pasuk of otzem einav meir’os b’ra, and says what kind of a case are we talking about? If he doesn’t need to be at that place, then he is a rasha for going there in the first place. If he does need to be there, then even if he sees something, he is an ones. The gemara answers that although he is not mechuyav to look away, because he is an ones, however, if he does than he is a chassid, meaning going above and beyond what he is required to do.
So it seems to depend on how strong the need to be there is. I don’t think the gemara meant one cannot go to work because he may see something. Work is a valid need or he will starve.