Op, you have the xm3 model that had problems in lower temperatures from the release. I heard they fixed it way later with newer batches. I think owners of the old ones are stuck with disabling the touch-area in the app.

I have the XM2 and XM4 and use them while riding a bike even when it gets really cold. No problems. https://i.imgur.com/IeU3K2a.jpg