“Excuse yourself that you have to leave, as soon as you smell the conversation even might veer into loshan hora.”
It is your obligation that others not speak L”H as well.
Try implementing a Machsom L’fi amongst your friends and co-workers (if possible) hopefully you can teach by example.