There's no reason that handling your own keys has to be something that you, personally, have to bother with. Just because you don't interact with the key handling doesn't mean it can't happen in a safe and secure environment on your local machine. Yes there are plenty of implementation concerns, but that doesn't mean they're insurmountable. It's so possible, in fact, that ongoing work is happening in exactly this space. See https://code.google.com/p/end-to-end/ for example.