frumladygit:
I think you already know the answer. You understand that this is not an ideal situation. Your husband has expressed his displeasure over this already. The only thing left to do is to hand up a big yellow neon sign over your head.
You will undoubtedly feel bad for a while about it. Even later if the name comes up you will feel a twinge. But like all things time will make it easier. I speak from experience as well. Why way your conscious with something you believe to be not 100% correct. Let it go, feel better about yourself and your path to Hashem and in a year or two from now you will be happy that you had the strength to do what is right for yourself.