My great great great grandfather fought for the confederacy in the Civil War. He had a guy in his company who thought just like you guys.
He thought it was stupid that grey meant confederacy. After all, what really counts is which side you are fighting for, not what color your jacket is. So he decided one day to wear blue (he pulled it off a dead union soldier).
He was shot by his own side within 1 minute of leaving his tent.