Solar panels lose efficiency at high temperatures, the dry environment creates a lot of dust which requires near constant cleaning of panels, and the spread-out nature of infrastructure in the southwest would drive up transmission and maintenance costs as well.