How is your ruchniyus suffering? Do you think that the problems in ruchniyus now are worse than the problems in ruchniyus you may face down the line when you have several mouths to feed and possibly very little income?
Perhaps you should look into a part time college or night courses, where you won’t have as much exposure to the atmosphere. As for the amount of homework and the pressure, what sort of “no life” does it leave you with? Are you missing out on all of your sedarim? If so, you definitely need to cut back on your course schedule. There is absolutely no reason why an undergraduate cannot learn at least four hours a day without interruption.