The latest heat pumps are rated down to -13F; they'll put out some heat but as you say they're not very efficient at that temperature. They're extracting heat from the air, and at colder temperatures there's less heat to extract.