TheRealSerdra
TheRealSerdra t1_iz6bpg4 wrote
Reply to comment by Drinniol in [D] Stable Diffusion 1 vs 2 - What you need to know by SleekEagle
I was heavily involved in the UD project at the start (have since stepped down) and tbh I’m skeptical. I think some good NSFW models will get made (some already have) but nothing truly spectacular.
TheRealSerdra t1_iwo4w46 wrote
Reply to comment by ReasonablyBadass in [R] Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning - Epochai Pablo Villalobos et al - Trend of ever-growing ML models might slow down if data efficiency is not drastically improved! by Singularian2501
Technically aren’t you always doing at least one epoch? You’re doing one pass through of all your data at least, even if that data is less than the amount you theoretically could use
TheRealSerdra t1_itm14nm wrote
Reply to comment by [deleted] in Large Language Models Can Self-Improve by xutw21
I’ve done similar things and while you can continue improving, you’ll hit a wall at some point. Where that wall is depends on a few different factors. That being said, this is nothing new. Iterative self improvement has been a thing for ages and is at the heart of some of the most impressive advances in RL. This is just applying a concept to language models, not inventing a new concept
TheRealSerdra t1_j944f39 wrote
Reply to comment by Sphere343 in [D] Please stop by [deleted]
What defines sentience? If I ask ChatGPT “what are you” it’ll say it’s ChatGPT, a LLM trained by OpenAI or something to that affect. Does that count as sentience or self awareness?