It is irresponsible to feed feral animals, no matter how kindhearted you think you are being. And justification just because it is a "cat" that can't be domesticated is no justification at all.
I hardly consider myself irresponsible and where I always try to see the good in people, I take your remark as a person who needs to be educated about why feral cats (and I'll just focus on cats) are a nuisance to people who don't know how to deal with strays.
I feed feral cats but I also trap them and have them fixed. It's called a trap, neuter, release. If I'm going to take the responsibity of feeding them, the humane thing to do is to have them fixed so they don't bring you litter after litter. There are many no cost clincs that believe in helping stray animals.
Read this, maybe it will help you deal with ferals that "bother you"
http://indyferal.org/Literature/Nuis...ion%20Tips.pdf