The writers did kind of nod to that a few times, like when Lily and Marshal mention how obnoxious Ted was in college and Ted goes into complete denial mode only to eventually realise it was true.