Sheine maidel:
When i was a boy of six i attended a chareidi yeshivish school. They had just purchased used benches for the beis medrash. I noticed that they had removed engravings of a tzelem from the benches. Even at that tender age, my intuition told me that it was wrong to have church benches in a beis medrash. So I asked my rebbe. Turns out my intuition had been wrong. It is in fact a mitzvah to uplift something from unholy to holy.
Here is a video of the kaliver rebbe singing a song purchased from a gentile shephard boy:
link removed -79