I have many workers and never really had a problem.
although i once posed this question to a rav and he said “I don’t know”
question, male and female have to finish project together, working together in office is yichud, going to starbucks, or dinner, highly inappropriate. what does he do?