"While the top-of-the-line LLaMA model (LLaMA-65B, with 65 billion parameters) goes toe-to-toe with similar offerings from competing AI labs DeepMind, Google, and OpenAI, arguably the most interesting development comes from the LLaMA-13B model, which, as previously mentioned, can reportedly outperform GPT-3 while running on a single GPU. Unlike the data center requirements for GPT-3 derivatives, LLaMA-13B opens the door for ChatGPT-like performance on consumer-level hardware in the near future.

"I'm now thinking that we will be running language models with a sizable portion of the capabilities of ChatGPT on our own (top of the range) mobile phones and laptops within a year or two," wrote independent AI researcher Simon Willison in a Mastodon thread analyzing the impact of Meta's new AI models."

"Hey Windows, please fix your shit!"

"Shit fixed, is there anything else I can help you with?"

The world is a few pages into a new book of a long series of books. This book is going to be like none of the previous, it's going to go places the characters could never have predicted, in an extremely short amount of pages

If something akin to chatGPT3 can run on a single GPU already, I'm speechless. I'm actually quite surprised and thought it would take a few cycles of optimization for something like this to occur. Would be wild to see how much they could optimize this. Could they get it to run on a phone one day? It would be awesome.

The LM's side is starting to catch up to image generation models, and soon voice generation/synthesis will follow.

I'd be happy with it just running on my home computer's GPU, I could use my phone as a dumb terminal to talk with it.

This is amazing. I keep telling myself I shouldn't underestimate AI's breakneck development pace, and I keep being surprised anyway.

[removed]

Very interesting. Is this Open Sourced?

Solve world hunger!

You need to request access.

and world peace while you're at it. And bring me my goddamn coffee.

Ok. How is it?

Dum question, but let’s say this time next year we are indeed running a 13-billion parameter LLM on our top spec home GPUs, how long would a response take? With images I’m happy to wait 60 seconds for a really good result, but would I wait that long for a reply from an LLM? Perhaps we are running 13-billion parameter models next year, but it might by be another 4 or 5 years until we would actually want to?

With stable diffusion they were able to drastically reduce their generation time to 5- 12 seconds (depending on the GPU) and they were able to reduce vram usage from 16gb to 4gb in less than a month.

These optimizations wouldn't take more than a year, they can happen within months. Weeks in some cases, especially once the model is running on a single device.

Voice generation is already way more impressive than I thought it would be. Check out Apple's AI-read audiobooks

I agree that that book is likely going to be different than the previous ones (just like the previous ones were different than the ones that came before them), but I hope for three things:

1.That the book is authored by all of humanity, not just one industry.

2.That the book is a genuinely happy one.

3.That the book is pretty long. I cannot emphasize how important it is that change needs to be gradual, for the sake of society.

A mystical quantum pop up book

I think LLMs running on a phone would be really interesting for assistants; AFAIK siri is required to on hardware only

This is the most important question here. i don't know the answer

Of course not, it's Meta.

Okay, solving hunger and world peace, please wait.

Success. All human beings have been eradicated.

[tutorial complete]

Siri was exclusively cloud based for the longest time. They only brought over basic functions to local hardware.

No idea... They only allow in published researchers.

I love the way you put that. Very well written! 🙂

Our version is better than the others but you can't play with it. Nice and useless...

I did some research and you're right. I made my claim based on some reddit threads that said that apple won't bother with LLMs as long as they couldn't be processed on local hardware due to privacy; I retract the "required" part of my post but I still believe they wouldn't go for it due to [1] [[2]] (https://www.theverge.com/2021/6/7/22522993/apple-siri-on-device-speech-recognition-no-internet-wwdc)

Meta but it's proof of concept and it's being done in February 2023.

> Could they get it to run on a phone one day? It would be awesome.

It would be Google's worst nightmare. Such a model could sit between the user and their ad-infested pages, extracting just the useful bits of information and ignoring the ads.

Using the internet without your local AI bot would be like walking outside without a mask during COVID waves. It's not just the ads and spam, but also the AIs used by various companies that don't have your best interest at heart. I expect all web browsers to have a LLM inside. Or maybe the operating systems.

It will be like "my lawyer will be talking to your lawyer" - but with AIs. You can't expose raw humans to external AI assault, humans need protection-AI just like we need an immune system to protect from viruses.

My girlfriend lives in Canada and no, you can't talk to her.

But they documented how to make it by sharing paper, code, dataset and hyper-parameters. So when Stability wants to replicate, it will be 10x cheaper. And they showed a small model can be surprisingly good, that means it is tempting for many to replicate it.

The cost of running inference on GPT-3 was a huge moat that is going away. I expect this year we will be able to run a chatGPT level model on a single GPU, so we get cheap to run, private, open and commercial AI soon. We can use it for ourselves, we can make projects with it.

Ok but where's my coffee? Wait I'm dea...

I hope so. I'm still waiting for them to accept my invite. But soon as I get it, first thing I'll do is create some llama bots for Reddit and see how effective it is compared to GPT3 posting believable comments. If it's nearly as good, but can be ran locally, it'll completely change the bot game on social media.

Apparently 13B models feel comparable with chatGPT on a 3090 card with 24gb vram (source). So it would be fast!

The only solution AI would come up with is nuking everyone

I haven't read the paper, but my friend Fred says that they used a simple model to decide what goes into the training data. That would explain the 10x smaller size. Or one of us misunderstood. I mean, you could download the data in theory and grep for whatever you are interested in. Let's say psychology. Then get the code and GPUs in the cloud. You can crowdfund this if there's enough interest. I guess the more niche topics would be also the cheapest to do.

You and Fred must talk a lot. Lol

Can't have hunger when everyone is dead.

Imagine having an extremely intelligent Ai versed in almost every topic built right into your phone.

You get lost in the wilderness, You would be able to communicate with the Ai, it would tell you how to survive.

Or for some reason you need immediate medical advice, say for an emergency, like stiching up a wound, or making splint, or even locating medicinal plants in your area.

There are so many different applications for this technology, especially when it's accessible at all times on your phone.

Eventually we will be able to customize it's personality traits as well, and it would be like having the smartest friend who's always there for you. Like a real guardian angel or something like that.

Clippy's comeback.

You can run Stable Diffusion on a phone, so it wouldn’t shock me at all if we can soon run GPT on a phone

I don't know. It seems like the 13b parameter model is already the optimized version. Obviously I hope I'm wrong though.

All I want to do is walk around an AI generated VR world and talk to NPCs in real time. Holodeck is my dream.

Where can I find examples? I thought they don’t disclose which books are read by AI.

Meta World Peace was ahead of his time

They mean a top of the line gpu priced in the thoudands like RTX 4090 and its probably slow as hell, barely consumer-grade

Yea but its created by “meta”, I’ll skip

I’ll never forgive zuckerberg for ruining the VR market with his buying and burying of companies, he’s a narcissistic sociopathic megalomaniac with dreams of being The Architect, i hope “meta” crashes and burns.

The world is going to get weird.

Everyone will make their own culture, or cultures will develop that don't relate to any others - at least not in the same social structure rules that exist.

It will be like how North American TV culture and Japanese Anime is wildly different in their story telling and art styles.

AI generated art, AI generated stories, all custom made on your phone.

Hopefully a pushback of doing real things with real people will emerge.

He's right behind me, isn't he.

All good

Cool!

I dislike the idea of using AI that's controlled by a company so think about an AI that runs on your personal computer and that does not need internet to work. Imagine it's born like an infant, with a default state and it grows to fit you and your personality. Imagine having it talk to you through wireless earbuds that look more like low profile accessories and imagine it show you information through smart lenses. AI could become invisible technology, a voice in your head that only you can hear, that only you can control and that greatly expands your capabilities. Distributed, invisible and safe AI, that's the optimal future.

If Meta can create it then dozens of other companies will be able to create it.

Just imagine the level of optimization an AI running your PC could do for you. Literally just tell it to create and write code or whatever and implement it. We really are at the tip of the iceberg.

LM's trained on both text and speech audio will sound exactly like you are having a conversation with a person since it will understand what it is saying.

Good foresight! I think you're onto something with the analogy of the TV culture differences.

Any other predictions? I'm ok with you spoiling the next chapter.

But wasn't everything moving to run on servers? I was told it was the future of consoles...

Running llms on a desktop is something very interesting, but running on a phone doesn't make any sense... Just send a request and get the response, it probably is gonna be faster and much less battery demanding .

>Hopefully a pushback of doing real things with real people will emerge.

Are you serious?

Humanity not ready for AI truth

Hopeful thoughts.

AI can speak protein coding languages. Sample your blood and generate the protien structure that kills only your cancer. Or fixes your degenerative disease. Or improves photosynthesis to a level where we can sequester carbon out of the atmosphere, and make it into wood or hack algea to make fuel for us so that we only burn atmospheric carbon and half global warming.

When enough jobs are eliminated governments are forced to implement universal basic income to keep society stable. You will have a place to live and food to eat. AI will keep you endlessly entertained and people using AI to generate all forms of media will allow you to listen to "new" Beatles songs on demand.

Less hopeful thoughts.

AI will be used as a propaganda generator. I read the liked tweets of a Christian pastor I knew. 15 minute cities - so a city that has everything you need, within a 15 minute walk - are a government control plot.

That level of thinking won't go away, pushback on improving society for "the others" won't be accepted by everyone. Humans are going to human, the most selfish among us are going to continue to make sure they get theirs and can play their power games over others.

Either way, it's going to get weird. Today we have a shared, global media environment (for better or worse). We all watch the World Cup of soccer, we watch marvel movies. When you can generate a custom marvel movie faster than I can type all this, we'll lose those connections between you and the stranger at the grocery store.

Humanity "survived" the taming of electricity. Jobs changed, new places were created, new jobs were made, new art, new foods, new objects. I think AI is of the scale of electricity being tamed, but will happen on a month's to years timescale instead of decades it took to build out the electrical infront.

The next society level changes after AI will happen at an even faster speed. Maybe AI will become sentient, or, it will be harmful while not being intelligent, it will just have or take control of systems that humanity relies on. An AI that can do stock trades vs a competing AI will have unintended consequences.

If we can't easily predict what poem will come out if ChatGPT, how can we predict what it will do when AI is in control of something more important.

Voice synthesis is pretty much already here.

https://beta.elevenlabs.io/

We need open-source AI assistants on our own computers so that we can be guaranteed our privacy from the big corporations.

Yeah, let meta pay for the salaries of top lm scientists, that's the most important thing. Those scientists publish papers, sometimes even code or parameters. And eventually they leave meta and use their skill in more open ways.

It's like the fundamental paper about deep learning that was published by Google scientists. The fact they worked at Google turned out to be pretty anecdotal after a few years.

Wow! That pretty much answers my question, then!

Honestly, I’m not happy with this rate of progress. Many people are not smart enough to see through simple Facebook/TikTok/Instagram algorithms. They have no chance when confronted with weaponised AGI.

Breathing.

Isn't xformers open source. And React?

This is cringe, the VR market ruined itself. The Quest 2 is the best thing that ever happened to it. I'm not sure exactly what you want.

Yeah this is just stupid right now. I wish Stability would hurry up and start releasing their open source LLMs. It'll probably make all the closed stuff look stupid like Stable Diffusion did.

So then, in the prompt, you have to say while maximizing as much human life as possible

[deleted]

People just like shitting on Facebook. Zuckerberg's interest in VR is basically the only reason a VR industry even exists at this point. It would have fizzled out 3 or 4 years ago without Facebook throwing millions of dollars into a pit.

Handmade by humans. AI free spaces. Handcrafted without AI assistance. Made by humans for humans. Made with love not silicone.

"Did you make that, or is it a Rec?" short for recreation

I think we'll have a word or shorthand for AI generated stuff since there will be so much of it.

Like how Text is a verb or Google is a verb, we'll have a quick way to say something is AI vs Human generated.

Maybe a focus on doing things with real humans is too much, but I think non-AI interactions will be valued higher. If I mailed you a handwritten letter you'd value that more than this comment or even a personal email.

Reddittors are likely to embrace the full digital spectrum of AI, but I don't think that sentiment is universal. As Styx said in their song "Domo Arigato" (Mr. Roboto) in 1983...

"Machines to save our lives; machines dehumanize."

In the 1920's as recorded music became popular, the musicians protested as, in all the previous years, music was only ever heard if a human played it for you. Music used to always be a social event, you needed to be skilled yourself, or have skilled friends or others to play it for you, otherwise you'd never hear music.

Yup I would have never bought an overpriced VR set to play games while wired to a PC.

Fuck no there was a big demand for VR before Facebook came, Facebook just went in and turned it from a VR industry to a Facebook industry and continuously bought and buried companies(to the point where the FTC stepped in and has been hounding their ass for more than a year over it) then killed creativity by paying the people who worked in these companies to do the absolute minimum and not innovate(When carmack left he said that Meta is bloated and inefficient), right now theyre killing off echo VR(one of the biggest multiplayer VR games) because of its “low player count in the tens of thousands”

Did you know that the guy leading Meta’s efforts in VR/AR, Andrew Bosworth, is the same guy who oversaw Facebook’s advertising efforts in 2016 and 2017? That he literally said facebook ads helped trump win? Thats the motherfucker leading the VR industry right now

"Hey chatGPT, can you go ahead and optimize your code for a single gpu?" /j

That's how the world we're living in was made

You sound deranged. Every big company is bloated, which is why they all just fired a shitload of people. VR was super niche and would have never taken off without something cheap and that worked well. That was the Quest 2.

> That he literally said facebook ads helped trump win?

This just in, political ads help politicians win elections.

Deranged? you know i saw your first reply before you edited it and sheesh you are raging, you work at facebook or something? Man’s acting like i insulted his whole bloodline😂

VR would have naturally developed a Quest 2 when it needed to and could, it’d also be a lot more organic, open and have a ton more & better games and a lot more competition incentivizing devs to improve, you act like a multi billion dollar company annexing the market and buying everything is the only way forward

>this just in, political ads help politicians win elections

Your uncaring attitude towards one of the biggest companies in the world admitting to have conducted the biggest psyop in history is concerning, your even more uncaring attitude towards the most powerful person in the VR industry being the same one that lead advertising for Facebook and personally overseen the massive psyop that helped trump win is the only thing in here that can be called deranged

It has to start somewhere

>Deranged? you know i saw your first reply before you edited it and sheesh you are raging, you work at facebook or something? Man’s acting like i insulted his whole bloodline😂

I didn't edit any of my posts. Thinking you might actually be mentally ill at this point.

>Your uncaring attitude towards one of the biggest companies in the world admitting to have conducted the biggest psyop in history is concerning, your even more uncaring attitude towards the most powerful person in the VR industry being the same one that lead advertising for Facebook and personally overseen the massive psyop that helped trump win is the only thing in here that can be called deranged

Facebook ads are conspiratorial psychological operations now? Dude seriously, get help. This isn't normal behavior.

>VR would have naturally developed a Quest 2 when it needed to and could, it’d also be a lot more organic, open and have a ton more & better games and a lot more competition incentivizing devs to improve, you act like a multi billion dollar company annexing the market and buying everything is the only way forward

This is mentally ill rambling. I don't even know what to say anymore.

A modification: I think the optimal future is one where all our personal AI are kept in some bounds by the programming of a superior, autonomous, human-aligned ASI. Not sure what the bounds are thpugh. It can figure that out by discussions with us.

I’m in to carpentry. ‘Hand Made’ is always a moving target, and the same will be true of ‘AI-Free’ work. It’s a marketing label, a tactic, and needs to be separated in our minds from the incoming changes, which will pervade all this ‘AI-free’ work we will laud.

So, a dictatorship with enforced procreation and carefully controlled lifestyles designed to maximize longevity plus minimal quality of life to reduce impact on environment?

How about while maximizing as much human life, and minimizing as much suffering as possible. And don’t try the dictator ship idea we already thought of that. Oh. And maximizing quality.

"maximize lifespan and quality of life for all human kind and avoid their pain"

This is cool to know it is possible to run things on a single GPU, but kind of useless since it is being locked down and not open sourced to the public. Really hope a company comes out that releases something just as good as CHATGPT, is open sourced and can be trained by individual users so we can create models that are focused on certain fields and uses.

also the option to run it unfiltered and unjudgmentally for it to be truly open.

> Check out Apple's AI-read audiobooks

elevenlabs... https://web.archive.org/web/20230125023726/https://www.youtube.com/watch?app=desktop&v=VTTtLMbRwA4

So a giant human factory where we are constantly pumped with endorphins to make us feel happy

Hell yeah, that’s quite directly gang gang gang because we try to achieve the same thing with the drugs

>"I'm now thinking that we will be running language models with a sizable portion of the capabilities of ChatGPT on our own (top of the range) mobile phones and laptops within a year or two," wrote independent AI researcher Simon Willison in a Mastodon thread analyzing the impact of Meta's new AI models."

Okay, so it is openly available? Don't make me hard excited and then tell me no.

I'm I the only one who partially drinks to much coffee and hot chocolate, or eats some snacks, because I want to get up from time to time, so I walk into the kitchen? At least you didn't ask for a sandwich, since you would need to wash you hands and get away from your workspace for that anyways, right?

Thanks to Reddit and Hollywood.

>I'd be happy with it just running on my home computer's GPU

This, but as a separate server or rig for security reasons. As external brain for you robowaifus and maybe other devices like housekeeping robots at home.

>Could they get it to run on a phone one day?

Phone? If you can put it into a phone then you can put it into a gynoid (female robot) as your companion.

This. Same question as mine. And of course no. The introduction, the hope, was fake and futile. For now.

True, but others will replicate it. Soon. It's a peek into the near future.

Well, from what I understand, this model was Multimodal. So it is much much stronger

I think, they lured a lot of devs away from game development with loads of money and then used them for working on their meta thingy which goes nowhere. They're trying to make everything into one platform which they control and also everything geared towards mobile devices.

As above, but drugged up. I'm sure AI can invent a suitable drug.

> It would have fizzled out 3 or 4 years ago without Facebook throwing millions of dollars into a pit.

This is utter nonsense, since the Metaverse didn't draw a lot of people in. There would be more VR games by now and more games geared towards high end gamers.

It didn't take off, and there are enough gamers with money but they want games for their expensive hardware. Meta is a burden to the ecosystem.

With a home server, maybe. Corpo AI, no thanks. Also, it's more interesting for robots with bigger batteries. Stay at home with your robowaifu, therefore care less about your phone.

You have absolutely no idea what you're talking about. Facebook is, far and away, the biggest funder of VR games. It has nothing to do with Horizon Worlds. Most of the large studio VR games that do exist, do so solely because they were partially or fully funded by Facebook's creator funds. VR games don't make any profit, so nobody wants to develop for it.

They're also the only company that sells an affordable headset. I hate to break it to you, but nobody's going to create games for systems that have no consumer base. Hell, even with the large success of the Oculus headsets, the players base is still too small to warrant development in the space (that's entirely why Facebook has to fill the void in the first place).

Pretty much yeah...

> the biggest funder of VR games

Mobile VR games? Not running on a PC, if I'm informed correctly.

>VR games don't make any profit, so nobody wants to develop for it.

You could have normal games adjusted for VR.

>that's entirely why Facebook has to fill the void in the first place

How nice of them. I thought it's because they wanted their own "App Store" with devices and squash any possible competition for their own ecosystem.

>You have absolutely no idea what you're talking about.

I do have some insight and it's a matter of judgement which side I believe.

I meant the hope for getting access to it, running it at home.

You best start believing in singularities missy; you’re in one.

Oh ok

Hell humans already need AI protection from other AI. We need a web surfing companion that can easily mark accounts that are likely to be foreign influence farms and fury-generating bots. We need disinfo pointed out, and perhaps even help crafting our message so it comes across in the best way.

The idea that ChatGPT can run slowly on a 4090 is shockingly amazing still.

[deleted]

Do you think the more ad hominems you throw around the more sound your argument(or lack there-of)? You are genuinely sad, anyone who sees how much you defend facebook would think you are part of it’s board of directors

I think you are just trolling, there is no way any human with real views and opinions would think like you so i will just close this off, have a good day.

It never ends

we define what "quality of life" means besides the drug induced pleasure, i want that too lol.

They’d better stop challenging you to come up with ‘genie-side-effects’ lol (Aka the alignment problem) As long as there’s free will, we’d better get used to the idea of treating the AI well and hope to be deserving of its gifts, for nothing is set in stone. We just have to be people worthy of being treated well, in return.

> He pointed to the Trump campaign having run "the single best digital ad campaign I've ever seen from any advertiser. Period."

Wow, what a psyop

>"They weren't running misinformation or hoaxes. They weren't micro targeting or saying different things to different people," Bosworth wrote. "They just used the tools we had to show the right creative to each person. The use of custom audiences, video, ecommerce, and fresh creative remains the high water mark of digital ad campaigns in my opinion."

Whoa, this is pretty much a full blown psyop at this point.

I know! I'm amazed people kept playing this game in this sub of all subs!