“Are you sure that the “people” who bother you really mean “literally” in the absolute,”
Yes. Ive encountered many people who insist that the Avos litteraly kept all the Mitzvos and I am a kofer for poitning out that it isnt possible
See this thread
https://www.theyeshivaworld.com/coffeeroom/topic/academies-of-shem-and-ever
(though nobody there called me a kofer)