Couple of reasons. First, hoar crystals growing on surfaces in subzero temps, glorious in the morning sunlight but with the structure of sandpaper. Also, much of your glide comes from tiny amounts of solid water changing phase under pressure as the ski transfers your bodyweight onto the snow, and at colder temperatures your skiing enjoys less of that.