Obviously you should find a color temperature that works for your setting, but in general, warm is a safer bet for preserving skin tones unless you are actively fighting daylight bulbs in the room.

Since warmer tones tend to be safer, I recommend it in the absence of more specifics about the environment. But you’re right, it’s not always the best fit.