Viewing a single comment thread. View all comments

ilc15 t1_j8xh1p8 wrote

Reply to comment by Psyese in [OC] The cost of training AI on ImageNet has decreased from over $1000 to just under $5 in just 4 years by giteam

I would guess better architecture for both models, hardware and frameworks. While tensorflow, pytorch and resnet are all from mid 2015/2016 i would guess it could take a year to fully integrate (be it improvements in the framework, or industries adopting them). Tensorflow and Pytorch are very popular ML packages, and resnet is an architecture which I thought is more data efficient than it's predecessors.

As for the hardware i dont know enough about their releases the same goes for updates in the cuda framework which improves gpu acceleration.

4

Bewaretheicespiders t1_j8xjz7f wrote

Resnet was far more efficient than vgg, but its also from 2016.

In the "efficiency first' route there's been resNet, then MobileNet, then many versions of EfficientNet.

3