Brake pads contain asbestos and other nasty stuff. It's certainly bad for you. You're not gonna noticeably hurt yourself if you eat roadside fruit a couple times, but the same can be said about many harmful things.
It's not yet banned for use in brake pads everywhere (not in the US as far as I know), and anyway more modern brake pads materials aren't significantly better for eating either.
