All you have to do is look at what the GRA held (I believe it was his talmid R’ Baruch?? who wrote it) about learning secular knowledge.
There is no Torah knowledge without learning general knowledge. Learning geometry will help you learn Gemarah so much better.
Using the “if only” logic, again, R’ Wolbe went to college as a non-frum secular Jew. He attended the “Hillel” of his days (staffed by great rabbanim, in college as well) and he turned out to become a nice frum man.