“is it safe to assume that the same is true when referring to a husband?”
Yes — it goes both ways. When talking to other women I will say “my husband” or “your husband” as appropriate, unless I am talking to a close family member, in which case I would use his first name. When speaking directly to my friend’s husbands I will use a title Mr./ Rabbi X — my husband addresses my friends as Mrs. X.