set -o vi

Starts you in insert mode. To go back to the usual command-line editing,

  set -o emacs