Some Poskim do mention that it should be avoided. There is a difference between having them dragging on the floor Derech Bizayon and just touching Derech Kavod because you are displaying your Tzitzis.
Also, I feel like it’s a Mefurash Gemara in Brachos that it’s Muttar.
Within the actual beis haknesses itself is ok and not a bizayon as we see from the clothes of the kohen gadol that dragged along the floor of the beis hamikdash. The floor is holy. However in other parts of the shul building it is a lack of kavod