I believe it’s actually a machlokes if the mitzva of tzitzis applies during the day or if wearing daytime clothes.
In addition to being mevatel the mitzvas asei, since everyone else is wearing tzitzis all day, one would likely be considered poresh min hatzibur if one decided that he knew better. Pirkei Avos (and, lihavdil, common sense) says not to do so.
Ask your LOR, especially regarding sports; I don’t see the sense in sweating up and walking around with sweaty tzitzis. So if you’re playing intense basketball in shorts and a tee shirt then it would make sense to me to leave the tzitzis off during that time on the court.