The_frozen_one
The_frozen_one t1_jd0sqd7 wrote
Reply to comment by RoyalCities in [Project] Alpaca-30B: Facebook's 30b parameter LLaMa fine-tuned on the Alpaca dataset by imgonnarelph
You can run llama-30B on a CPU using llama.cpp, it's just slow. The alpaca models I've seen are the same size as the llama model they are trained on, so I would expect running the alpaca-30B models will be possible on any system capable of running llama-30B.
The_frozen_one t1_jcb4t0y wrote
Reply to comment by NoScallion2450 in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
> Well that depends on whether OpenAI can prove Google is deriving commerical value from OpenAI's patented research.
That's not an issue, people make money due to patented technologies all the time. That's different from infringing on a patent. Either way, it would be an incredibly messy battle. Google invented the T in GPT, I can't imagine Google doesn't have a deep AI patent portfolio.
The_frozen_one t1_jbzv0gt wrote
Reply to comment by remghoost7 in [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692
It takes about 7 seconds to generate a full response using 13B to a prompt with the default (128) number of predicted tokens.
The_frozen_one t1_jbzqvwc wrote
Reply to comment by remghoost7 in [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692
I'm running it using https://github.com/ggerganov/llama.cpp. The 4-bit version of 13b runs ok without GPU acceleration.
The_frozen_one t1_jaq1x14 wrote
Reply to comment by ozwegoe in The Vyvanse patent expires this year. How long does it usually take generic alternatives to get approved, and how much of a reduction in cost is expected on average? by paleselan1
They can't extend the life of the patent. They can claim that the process for making the drug is patented, and they can claim multiple steps in the process to make the drug are patented. Generic companies would have to see if they can make the drug without violating these patents, or they might have to challenge them.
The_frozen_one t1_j2xnqt4 wrote
Reply to comment by Craterdome in Why TikTok’s future has never been so cloudy by prehistoric_knight
Then why not generalize this? Why is it ok for any number of companies to collect data on US citizens, well beyond what is necessary to operate, with little to no oversight or accountability? The solution isn’t adhoc. Make all tech companies accountable. Require any company that meets a size threshold to have a regular external audit of their practices, with big enough repercussions for violations that companies can’t just pay a small fine and change nothing.
TikTok is low hanging fruit, but what’s the point if data brokers can legally resell mountains of information about you? The truth is TikTok isn’t breaking the law in most instances, we just don’t have any law that prevents what they are doing. National security arguments can’t be where this is fought, because we’ve seen over and over that countries will claim everything they don’t like is a national security issue.
The_frozen_one t1_iykajiv wrote
Reply to comment by Acceptable-Cress-374 in [Project] I used whisper to transcribe 2500 episodes from around 80 podcasts and made it searchable. by t0mkaka
You can play around with it here: https://whisper.ggerganov.com/
It's significantly slower (approx 50 times slower) than the natively compiled version (https://github.com/ggerganov/whisper.cpp) but you can at least get a sense of accuracy using the online version.
The_frozen_one t1_ivip64b wrote
Reply to comment by mt-beefcake in [D] At what tasks are models better than humans given the same amount of data? by billjames1685
The_frozen_one t1_jd125zf wrote
Reply to comment by mycall in [Project] Alpaca-30B: Facebook's 30b parameter LLaMa fine-tuned on the Alpaca dataset by imgonnarelph
Not sure I understand. Is it better? Depends on what you're trying to do. I can say that alpaca-7B and alpaca-13B operate as better and more consistent chatbots than llama-7B and llama-13B. That's what standard alpaca has been fine-tuned to do.
Is it bigger? No, alpaca-7B and 13B are the same size as llama-7B and 13B.