SimonJDPrince t1_j72bw7l wrote on February 3, 2023 at 3:56 PM

Explained in my forthcoming book:

https://udlbook.github.io/udlbook/

Should be a good place to start, and if it isn't then I'm really interested to know where you struggled so I can improve the explanation.

fermangas t1_j734867 wrote on February 3, 2023 at 6:55 PM

I was going to recommend this book. You beat me to it.

jmmcd t1_j7qb9i1 wrote on February 8, 2023 at 5:34 PM

This book is really excellent! I'm working through it and collecting a few typos. I'll pass them on when done. I'm going to recommend it to my students this semester.

SAbdusSamad OP t1_j757w05 wrote on February 4, 2023 at 3:56 AM

I recently obtained a PDF of the book and began searching for information on ViT. Unfortunately, it appears that the book does not cover this topic. However, I plan to utilize the Transformer chapter to gain an understanding of ViT.

SimonJDPrince t1_j784yjf wrote on February 4, 2023 at 8:26 PM

ViT is at the end of the transformers chapter. Perhaps I forgot to put it in the index?

SAbdusSamad OP t1_j79ub7q wrote on February 5, 2023 at 4:34 AM

I apologize for that oversight. Yes, the book does cover Transformers for images.

42gauge t1_j7eal36 wrote on February 6, 2023 at 3:52 AM

What are the math/ML prerequisites for this text?

SimonJDPrince t1_j7htrs8 wrote on February 6, 2023 at 10:11 PM

Pretty much nothing to get through the first half. High school calculus and a basic grasp of probability. Should be accessible to almost everyone. Second half needs more knowledge of probability, but I'm filling out appendices with this info.