It absolutely can be done. I know of several people that do and will be there myself one day.

Using you funds in the smartest way possible means learning to conserve. It's the low hanging fruit. Plug strips/kill switches on everything, Kill-A-Watt meter to see what's the biggest draw, off grid (instead of "high efficiency") appliances, clothesline instead of dryer, etc.