Viewing a single comment thread. View all comments

rpnewc t1_jc5u6xd wrote

Check out Lucidrains great github repo. Works beautifully.

5

PM_ME_JOB_OFFER t1_jc5z6f0 wrote

Yo who IS this guy? He's got implementations for everything! How is anyone that productive?

3

femboyxx98 t1_jc601pw wrote

The actual implementation of most models is quite simple and he often reuses the same building blocks. The challenge is obtaining the dataset and actually training the models (and hyper parameter search) and he doesn’t provide any trained weights himself - it’s hard to know if his implementations even work out of the box.

9

therentedmule t1_jc86u50 wrote

Many repos are not usable and have click-bait names (e.g., palm-Rlhf)

1