Bricklaying requires much more labor than wooden frame construction. And it requires more skill which most contractors do not have.
It's more expensive for these basic economic reasons.