My Rov has told me many times I have no Chiyuv to give anyone who does not have a letter from our local Va’ad.
Besides I agree with apushatayid. Every penny I give to someone means someone else doesn’t get it (excluding my own additional generosity, of course :-). Best to give it to the people who need it the most.