Yep. The big thing is food availability. Large horse breeds can't subsist purely off grass, there just aren't enough calories in there. Supplementing with grain, however, works quite well. Even without intentional selective breeding, domestication improved their food prospects enough to enable larger and larger horses