It honestly bothers me when even Rabbonim come up with these meta-Halachic concepts about music affecting the soul or whatever. If these things were true, they would have a source in the Gemara or Halachah. Yes, we have Halachos against inappropriate songs. Yes, everyone should be smart enough to realize that if something affects you badly spiritually, not to do it. But to say things like a person puts his soul into his music and therefore listening to music from a bad person necessarily affects you, there’s just no source for that. I don’t get it.
(I could hear avoiding something with a composer who was a Rasha to avoid giving a Sheim to a Rasha. But not because of the music per se.)