We all have our styles and dress codes. I’m not aware that typically bochurim don’t wear sweaters, but if in your community they don’t you have three choices:
1. Follow the crowd.
2. Do as you please and not care about the crowd.
3. Move and find a crowd whose styles align with yours.