The original horses were quite small. They’re only very large now because of thousands of years of selectively breading them to be ridden

And there was probably some horseback riding before, but speculation without evidence is meaningless. This is simply the earliest evidence we have