We’ve had this discussion numerous times in various threads in the CR.
Although it may not be what you learned in Yeshiva, the mainstream opinion of Rishonim and Gedolei Acharonim is that Medrashim and Agadeta Gemaros are not Torah M’Sinai and we are not required to accept them as being literally true.