Then you'd have the windows closed so that the tiny amount of heat that does come in through a well-insulated house, can go into the ground which is always the annual average temperature.