I shoot in winter out of an open window at around 80mph but keep my hands and camera out of the slipstream ! My minimum is to wear a pair of kid leather gloves, sometimes I also put on thin latex gloves underneath as a layer ( l like rubber anyway) 
In my bag I keep within reach a pair of Thinsulate gloves with inbuilt battery powered warmer. The warmth is low background  but it really works and as i suffer badly from Renouds syndrome I need them. They are too bulky to use when shooting but are great in between.