We had that problem. Thanks to the cat lovers lobby, cats are a much protected breed by law in New York City.
There are altruistic sorts who will take the cats away to have them neutered (free of charge) and might not bring them back; as in our case.