When people make the argument OP is making they're leaving out that they don't want agriculture to leave. If it did, the state would probably go through a very long recession due to home prices diving and the economy tanking.

This story also has to do with California's centralization of economic power and influence, which is why so many water ways have been moved here.