I agree, I'll walk by them and they don't stop me and they're always smiling which I honestly have no problem with. If you're not harassing people or bothering them, do whatever you want.

It's not like those "charitable" organizations where they stand in front of you and say "you look like a nice guy! :D" and then try too hard to have a normal conversation with you up until they start asking for money.