I've had trouble with phone at low temperatures before, even when carried inside my parka, and inside a lifeproof case. Modern smartphones are not made to withstand life threatening temperatures for any length of time.

That said, something like this would be better than nothing.