As I understand it, the temperature is cold in space, but it's still difficult to transfer heat from yourself to the environment (because there's nothing in the environment to absorb the energy).

You don't want low temperatures for their own sake; you want them to facilitate heat loss.