I used to live near Montgomery, AL. If it were me I would buy a much smaller house. I made a little less than you and found a beautiful remodeled house 1200 sq ft house which I sold in October 2021 for 150k. It was plenty for just a couple of people with much lower utility and maintanance bills. ie power to heat and cool, roofing, plumbing, and electrical. Interest rates are at 6% so you are paying 15k in interest a year on a 250k house.

Just my two cents.