It’s not pritzus,but it is a challenge, not an excuse not to do Hachnossas Oirchim!
If you are inviting someone who doesn’t have a place or is otherwise a nitzrach to be MiKayem HaChnosas Orchim that is very different than inviting your good friends who B’H have a very nice home and you are primarily focusing on the “social.”
It doesn’t mean that it is inherently wrong to socialize, it’s just a question of priorities and in which derech you want to go.
I once heard from R. Meir Stern a similar thing. He was talking about how a ben Aliyah doesn’t socialize as much. Not that there is anything wrong with people who enjoy socializing, just that socializing is not the derech to be koneh the “Keser Torah”, etc. See, e.g., Rambam hilchos Talmud Torah on “Keser Torah”, the “Crown of Torah’, which can be acquired by one who dedicates his nights to the study of Torah.