This guy makes a similar comparison in his blog but goes into a bit more detail than the tweet.

https://trees.substack.com/p/false-dichotomy-and-disillusion-in

Is it worth creating your own models or extensively fine-tuning foundational models? Probably not.