Yungerman,
I am in a position similar to yours, except my emotional attachment to those beliefs is somewhat less. Just go along with what makes you feel good. If you “feel” an attachment to God by going to shul etc. on Yom Kippur or if it makes you/ your wife feel good then do it. Some introspection and thinking about how you can improve yourself and make yourself a better person is a good thing even if there is no God and/or Yom Kippur is a man made holiday.