People built houses for millenia. In America the small scale builders were here pretty recently - even now, I suspect, you can find them all across the country. I would be surprised if people completely forgot how to build houses all by themselves.