I make a point of carrying a few Cliff Bars in my backpack, to offer to people who ask for money. Some people turn them down, but a number also happily accept them.

There are no good solutions, but this is the best compromise I've come up with so far.