Submitted by Foundation12a t3_zyau7z in singularity
shmoculus t1_j28yfux wrote
Reply to comment by CypherLH in For those of you who expect AI progress to slow next year: by Foundation12a
I kind of see what you are getting at, and it could be the case with exponential improvements in methods/research that we see more discoveries in one year than all the previous at some point but I don't think we're there yet.
The progression has been linear in my view:
-
Efficient image classification (CNNs)
-
object detection / segmentation / pix2pix / basic img2text models (RCNNs, Unet, GANs)
-
Deep reinforcement learning (DQN, PPO, MCTS)
-
Attention networks (transformers and language modelling)
-
Basic question / answer and reasoning models
-
Low quality txt2img models (e.g. DALL-E 1)
-
High quality txt2img models (e.g. DALL-E 2, stable diffusion)
-
Multimodal modals (image understading etc) <- we are here
-
Already happening video2video models, text2mesh / point cloud
-
Expect low, then high quality multimodal generation models e.g. txt2video + music
-
Expect improved text understanding, general chat behaviour, ie large step ups in chatbot usefulness inclution ability to take actions (this part is already underway)
-
Expect some kind of attention based method for reading and writing to storage (i.e memory) and possibly online learning / continuous improvement
13 . More incrementally interesting stuff :)
CypherLH t1_j2b0ncx wrote
"Linear" but consider how rapidly the last half of your points progressed! It took nearly a decade to go from step 1 to step 6. In then took 18 months to go from step 6 to step 9, and probably less than another 12 months to get to step 11 based on current rates of progress.
shmoculus t1_j2byyzm wrote
It's going to be an interesting decade for sure :)
Viewing a single comment thread. View all comments