I agree with your concerns although I think they are pretty analogous to people stealing gold out of banks. There's no recourse from that and if enough big gold reserves vanished I'm sure the gold market would be screwed up.

Of course those physical breakins are probly much much harder to pull off than hacking an electronic bank.