I've only had to work in vegetable and fruit gardens belonging to my grandmother, but if it scales, then yes, it would be backbreaking. Only worth it if you enjoy it or otherwise derive self-actualization from it etc.