You can’t just decide to “hold like him”. A concept discussed by the mainstream seforim cannot be waved away.
When you lack a belief in something discussed by “everyone”, quoting a source for your position does not justify it. It may be a legitimate shita, but not accepting the plausability of the mainstream opinion is not an option. We do not have the ability to pick sides in such cases.