I might be wrong, but I think that Hertz was the accepted text used as Geordie said, but I also think it’s possible that it might have been problematic. But I’m really not sure, and I don’t think this is the best place to find out. I think you should try to find out but not here.
In any case,the main issue here is not the Hertz Chumash but the Shul itself. Was there anything else that seemed off to you? Do you know how this shul is viewed by others? How did you end up there?
Maybe you want to start off trying out a mainstream shul that you know is okay? I’m just concerned because you don’t really have enough of a background to be able to tell if a shul is really okay or not. That’s why it might be best for you to try a shul that you know is acceptable (if it exists where you live).