Comments

You must log in or register to comment.

AylaDoesntLikeYou OP t1_ja1rap6 wrote

"While the top-of-the-line LLaMA model (LLaMA-65B, with 65 billion parameters) goes toe-to-toe with similar offerings from competing AI labs DeepMind, Google, and OpenAI, arguably the most interesting development comes from the LLaMA-13B model, which, as previously mentioned, can reportedly outperform GPT-3 while running on a single GPU. Unlike the data center requirements for GPT-3 derivatives, LLaMA-13B opens the door for ChatGPT-like performance on consumer-level hardware in the near future.

"I'm now thinking that we will be running language models with a sizable portion of the capabilities of ChatGPT on our own (top of the range) mobile phones and laptops within a year or two," wrote independent AI researcher Simon Willison in a Mastodon thread analyzing the impact of Meta's new AI models."

142

MarginCalled1 t1_ja1vrii wrote

"Hey Windows, please fix your shit!"

"Shit fixed, is there anything else I can help you with?"

83

Tigerowski t1_ja257s6 wrote

Solve world hunger!

21

manubfr t1_ja28jbt wrote

and world peace while you're at it. And bring me my goddamn coffee.

16

jeweliegb t1_ja2n5w3 wrote

Okay, solving hunger and world peace, please wait.

Success. All human beings have been eradicated.

23

manubfr t1_ja2u74f wrote

Ok but where's my coffee? Wait I'm dea...

11

gangstasadvocate t1_ja4b4lx wrote

So then, in the prompt, you have to say while maximizing as much human life as possible

3

jeweliegb t1_ja50pgg wrote

So, a dictatorship with enforced procreation and carefully controlled lifestyles designed to maximize longevity plus minimal quality of life to reduce impact on environment?

7

dasnihil t1_ja5157a wrote

"maximize lifespan and quality of life for all human kind and avoid their pain"

4

jeweliegb t1_ja5u4p6 wrote

As above, but drugged up. I'm sure AI can invent a suitable drug.

3

Shamwowz21 t1_ja7xrj8 wrote

They’d better stop challenging you to come up with ‘genie-side-effects’ lol (Aka the alignment problem) As long as there’s free will, we’d better get used to the idea of treating the AI well and hope to be deserving of its gifts, for nothing is set in stone. We just have to be people worthy of being treated well, in return.

2

jeweliegb t1_jaa1uc8 wrote

I know! I'm amazed people kept playing this game in this sub of all subs!

2

dasnihil t1_ja7fyg2 wrote

we define what "quality of life" means besides the drug induced pleasure, i want that too lol.

1

gangstasadvocate t1_ja50xb7 wrote

How about while maximizing as much human life, and minimizing as much suffering as possible. And don’t try the dictator ship idea we already thought of that. Oh. And maximizing quality.

1

Procrasterman t1_ja5dtu7 wrote

So a giant human factory where we are constantly pumped with endorphins to make us feel happy

2

gangstasadvocate t1_ja5e3hk wrote

Hell yeah, that’s quite directly gang gang gang because we try to achieve the same thing with the drugs

1

ohErr t1_ja39i5v wrote

Meta World Peace was ahead of his time

1

NoidoDev t1_ja5q0rs wrote

I'm I the only one who partially drinks to much coffee and hot chocolate, or eats some snacks, because I want to get up from time to time, so I walk into the kitchen? At least you didn't ask for a sandwich, since you would need to wash you hands and get away from your workspace for that anyways, right?

1

FusionRocketsPlease t1_ja3p9fb wrote

But wasn't everything moving to run on servers? I was told it was the future of consoles...

5

katiecharm t1_ja5z6ao wrote

You best start believing in singularities missy; you’re in one.

2

NoidoDev t1_ja5pma9 wrote

>"I'm now thinking that we will be running language models with a sizable portion of the capabilities of ChatGPT on our own (top of the range) mobile phones and laptops within a year or two," wrote independent AI researcher Simon Willison in a Mastodon thread analyzing the impact of Meta's new AI models."

Okay, so it is openly available? Don't make me hard excited and then tell me no.

1

z57 t1_ja1waun wrote

The world is a few pages into a new book of a long series of books. This book is going to be like none of the previous, it's going to go places the characters could never have predicted, in an extremely short amount of pages

117

JVM_ t1_ja3dyu5 wrote

The world is going to get weird.

Everyone will make their own culture, or cultures will develop that don't relate to any others - at least not in the same social structure rules that exist.

It will be like how North American TV culture and Japanese Anime is wildly different in their story telling and art styles.

AI generated art, AI generated stories, all custom made on your phone.

Hopefully a pushback of doing real things with real people will emerge.

24

SurroundSwimming3494 t1_ja3u7ip wrote

>Hopefully a pushback of doing real things with real people will emerge.

Are you serious?

9

JVM_ t1_ja4feit wrote

Handmade by humans. AI free spaces. Handcrafted without AI assistance. Made by humans for humans. Made with love not silicone.

"Did you make that, or is it a Rec?" short for recreation

I think we'll have a word or shorthand for AI generated stuff since there will be so much of it.

Like how Text is a verb or Google is a verb, we'll have a quick way to say something is AI vs Human generated.

Maybe a focus on doing things with real humans is too much, but I think non-AI interactions will be valued higher. If I mailed you a handwritten letter you'd value that more than this comment or even a personal email.

Reddittors are likely to embrace the full digital spectrum of AI, but I don't think that sentiment is universal. As Styx said in their song "Domo Arigato" (Mr. Roboto) in 1983...

"Machines to save our lives; machines dehumanize."

In the 1920's as recorded music became popular, the musicians protested as, in all the previous years, music was only ever heard if a human played it for you. Music used to always be a social event, you needed to be skilled yourself, or have skilled friends or others to play it for you, otherwise you'd never hear music.

13

Drown_The_Gods t1_ja4x637 wrote

I’m in to carpentry. ‘Hand Made’ is always a moving target, and the same will be true of ‘AI-Free’ work. It’s a marketing label, a tactic, and needs to be separated in our minds from the incoming changes, which will pervade all this ‘AI-free’ work we will laud.

7

z57 t1_ja3o7gp wrote

Good foresight! I think you're onto something with the analogy of the TV culture differences.

Any other predictions? I'm ok with you spoiling the next chapter.

3

JVM_ t1_ja3vzwl wrote

Hopeful thoughts.

AI can speak protein coding languages. Sample your blood and generate the protien structure that kills only your cancer. Or fixes your degenerative disease. Or improves photosynthesis to a level where we can sequester carbon out of the atmosphere, and make it into wood or hack algea to make fuel for us so that we only burn atmospheric carbon and half global warming.

When enough jobs are eliminated governments are forced to implement universal basic income to keep society stable. You will have a place to live and food to eat. AI will keep you endlessly entertained and people using AI to generate all forms of media will allow you to listen to "new" Beatles songs on demand.

Less hopeful thoughts.

AI will be used as a propaganda generator. I read the liked tweets of a Christian pastor I knew. 15 minute cities - so a city that has everything you need, within a 15 minute walk - are a government control plot.

That level of thinking won't go away, pushback on improving society for "the others" won't be accepted by everyone. Humans are going to human, the most selfish among us are going to continue to make sure they get theirs and can play their power games over others.

Either way, it's going to get weird. Today we have a shared, global media environment (for better or worse). We all watch the World Cup of soccer, we watch marvel movies. When you can generate a custom marvel movie faster than I can type all this, we'll lose those connections between you and the stranger at the grocery store.

Humanity "survived" the taming of electricity. Jobs changed, new places were created, new jobs were made, new art, new foods, new objects. I think AI is of the scale of electricity being tamed, but will happen on a month's to years timescale instead of decades it took to build out the electrical infront.

The next society level changes after AI will happen at an even faster speed. Maybe AI will become sentient, or, it will be harmful while not being intelligent, it will just have or take control of systems that humanity relies on. An AI that can do stock trades vs a competing AI will have unintended consequences.

If we can't easily predict what poem will come out if ChatGPT, how can we predict what it will do when AI is in control of something more important.

9

SurroundSwimming3494 t1_ja2gp8i wrote

I agree that that book is likely going to be different than the previous ones (just like the previous ones were different than the ones that came before them), but I hope for three things:

1.That the book is authored by all of humanity, not just one industry.

2.That the book is a genuinely happy one.

3.That the book is pretty long. I cannot emphasize how important it is that change needs to be gradual, for the sake of society.

13

SirDidymus t1_ja2o8y3 wrote

I love the way you put that. Very well written! 🙂

4

Ok-Ability-OP t1_ja1y5t4 wrote

If something akin to chatGPT3 can run on a single GPU already, I'm speechless. I'm actually quite surprised and thought it would take a few cycles of optimization for something like this to occur. Would be wild to see how much they could optimize this. Could they get it to run on a phone one day? It would be awesome.

78

FaceDeer t1_ja23lku wrote

I'd be happy with it just running on my home computer's GPU, I could use my phone as a dumb terminal to talk with it.

This is amazing. I keep telling myself I shouldn't underestimate AI's breakneck development pace, and I keep being surprised anyway.

60

Z1BattleBoy21 t1_ja2jtse wrote

I think LLMs running on a phone would be really interesting for assistants; AFAIK siri is required to on hardware only

12

duffmanhb t1_ja2nzfa wrote

Siri was exclusively cloud based for the longest time. They only brought over basic functions to local hardware.

11

NoidoDev t1_ja5sjcu wrote

>I'd be happy with it just running on my home computer's GPU

This, but as a separate server or rig for security reasons. As external brain for you robowaifus and maybe other devices like housekeeping robots at home.

1

visarga t1_ja2tdeu wrote

> Could they get it to run on a phone one day? It would be awesome.

It would be Google's worst nightmare. Such a model could sit between the user and their ad-infested pages, extracting just the useful bits of information and ignoring the ads.

Using the internet without your local AI bot would be like walking outside without a mask during COVID waves. It's not just the ads and spam, but also the AIs used by various companies that don't have your best interest at heart. I expect all web browsers to have a LLM inside. Or maybe the operating systems.

It will be like "my lawyer will be talking to your lawyer" - but with AIs. You can't expose raw humans to external AI assault, humans need protection-AI just like we need an immune system to protect from viruses.

37

katiecharm t1_ja602o7 wrote

Hell humans already need AI protection from other AI. We need a web surfing companion that can easily mark accounts that are likely to be foreign influence farms and fury-generating bots. We need disinfo pointed out, and perhaps even help crafting our message so it comes across in the best way.

1

gelukuMLG t1_ja1zm8l wrote

The LM's side is starting to catch up to image generation models, and soon voice generation/synthesis will follow.

18

Zer0D0wn83 t1_ja2djip wrote

Voice generation is already way more impressive than I thought it would be. Check out Apple's AI-read audiobooks

8

Antiabed t1_ja389cp wrote

Where can I find examples? I thought they don’t disclose which books are read by AI.

2

SimpingForAI t1_ja3nbeh wrote

LM's trained on both text and speech audio will sound exactly like you are having a conversation with a person since it will understand what it is saying.

2

Akashictruth t1_ja3awb4 wrote

They mean a top of the line gpu priced in the thoudands like RTX 4090 and its probably slow as hell, barely consumer-grade

3

katiecharm t1_ja605k0 wrote

The idea that ChatGPT can run slowly on a 4090 is shockingly amazing still.

2

NoidoDev t1_ja5sofb wrote

>Could they get it to run on a phone one day?

Phone? If you can put it into a phone then you can put it into a gynoid (female robot) as your companion.

2

HermanCainsGhost t1_ja30rfd wrote

You can run Stable Diffusion on a phone, so it wouldn’t shock me at all if we can soon run GPT on a phone

1

AylaDoesntLikeYou OP t1_ja2zsiw wrote

Imagine having an extremely intelligent Ai versed in almost every topic built right into your phone.

You get lost in the wilderness, You would be able to communicate with the Ai, it would tell you how to survive.

Or for some reason you need immediate medical advice, say for an emergency, like stiching up a wound, or making splint, or even locating medicinal plants in your area.

There are so many different applications for this technology, especially when it's accessible at all times on your phone.

Eventually we will be able to customize it's personality traits as well, and it would be like having the smartest friend who's always there for you. Like a real guardian angel or something like that.

20

Intrepid_Meringue_93 t1_ja3j9th wrote

I dislike the idea of using AI that's controlled by a company so think about an AI that runs on your personal computer and that does not need internet to work. Imagine it's born like an infant, with a default state and it grows to fit you and your personality. Imagine having it talk to you through wireless earbuds that look more like low profile accessories and imagine it show you information through smart lenses. AI could become invisible technology, a voice in your head that only you can hear, that only you can control and that greatly expands your capabilities. Distributed, invisible and safe AI, that's the optimal future.

12

turnip_burrito t1_ja4urgn wrote

A modification: I think the optimal future is one where all our personal AI are kept in some bounds by the programming of a superior, autonomous, human-aligned ASI. Not sure what the bounds are thpugh. It can figure that out by discussions with us.

3

Akashictruth t1_ja3bdd7 wrote

Yea but its created by “meta”, I’ll skip

I’ll never forgive zuckerberg for ruining the VR market with his buying and burying of companies, he’s a narcissistic sociopathic megalomaniac with dreams of being The Architect, i hope “meta” crashes and burns.

20

SgathTriallair t1_ja3k7q0 wrote

If Meta can create it then dozens of other companies will be able to create it.

14

duboispourlhiver t1_ja3xgph wrote

Yeah, let meta pay for the salaries of top lm scientists, that's the most important thing. Those scientists publish papers, sometimes even code or parameters. And eventually they leave meta and use their skill in more open ways.

It's like the fundamental paper about deep learning that was published by Google scientists. The fact they worked at Google turned out to be pretty anecdotal after a few years.

8

BlueShipman t1_ja47sm1 wrote

This is cringe, the VR market ruined itself. The Quest 2 is the best thing that ever happened to it. I'm not sure exactly what you want.

8

TeamPupNSudz t1_ja4e7gi wrote

People just like shitting on Facebook. Zuckerberg's interest in VR is basically the only reason a VR industry even exists at this point. It would have fizzled out 3 or 4 years ago without Facebook throwing millions of dollars into a pit.

7

BlueShipman t1_ja4gls9 wrote

Yup I would have never bought an overpriced VR set to play games while wired to a PC.

1

NoidoDev t1_ja5u97e wrote

> It would have fizzled out 3 or 4 years ago without Facebook throwing millions of dollars into a pit.

This is utter nonsense, since the Metaverse didn't draw a lot of people in. There would be more VR games by now and more games geared towards high end gamers.

0

TeamPupNSudz t1_ja5v4bb wrote

You have absolutely no idea what you're talking about. Facebook is, far and away, the biggest funder of VR games. It has nothing to do with Horizon Worlds. Most of the large studio VR games that do exist, do so solely because they were partially or fully funded by Facebook's creator funds. VR games don't make any profit, so nobody wants to develop for it.

They're also the only company that sells an affordable headset. I hate to break it to you, but nobody's going to create games for systems that have no consumer base. Hell, even with the large success of the Oculus headsets, the players base is still too small to warrant development in the space (that's entirely why Facebook has to fill the void in the first place).

2

NoidoDev t1_ja5xedu wrote

> the biggest funder of VR games

Mobile VR games? Not running on a PC, if I'm informed correctly.

>VR games don't make any profit, so nobody wants to develop for it.

You could have normal games adjusted for VR.

>that's entirely why Facebook has to fill the void in the first place

How nice of them. I thought it's because they wanted their own "App Store" with devices and squash any possible competition for their own ecosystem.

>You have absolutely no idea what you're talking about.

I do have some insight and it's a matter of judgement which side I believe.

1

Akashictruth t1_ja4hl1x wrote

Fuck no there was a big demand for VR before Facebook came, Facebook just went in and turned it from a VR industry to a Facebook industry and continuously bought and buried companies(to the point where the FTC stepped in and has been hounding their ass for more than a year over it) then killed creativity by paying the people who worked in these companies to do the absolute minimum and not innovate(When carmack left he said that Meta is bloated and inefficient), right now theyre killing off echo VR(one of the biggest multiplayer VR games) because of its “low player count in the tens of thousands”

Did you know that the guy leading Meta’s efforts in VR/AR, Andrew Bosworth, is the same guy who oversaw Facebook’s advertising efforts in 2016 and 2017? That he literally said facebook ads helped trump win? Thats the motherfucker leading the VR industry right now

0

BlueShipman t1_ja4jm6p wrote

You sound deranged. Every big company is bloated, which is why they all just fired a shitload of people. VR was super niche and would have never taken off without something cheap and that worked well. That was the Quest 2.

> That he literally said facebook ads helped trump win?

This just in, political ads help politicians win elections.

2

Akashictruth t1_ja4nasi wrote

Deranged? you know i saw your first reply before you edited it and sheesh you are raging, you work at facebook or something? Man’s acting like i insulted his whole bloodline😂

VR would have naturally developed a Quest 2 when it needed to and could, it’d also be a lot more organic, open and have a ton more & better games and a lot more competition incentivizing devs to improve, you act like a multi billion dollar company annexing the market and buying everything is the only way forward

>this just in, political ads help politicians win elections

Your uncaring attitude towards one of the biggest companies in the world admitting to have conducted the biggest psyop in history is concerning, your even more uncaring attitude towards the most powerful person in the VR industry being the same one that lead advertising for Facebook and personally overseen the massive psyop that helped trump win is the only thing in here that can be called deranged

1

BlueShipman t1_ja4tnrr wrote

>Deranged? you know i saw your first reply before you edited it and sheesh you are raging, you work at facebook or something? Man’s acting like i insulted his whole bloodline😂

I didn't edit any of my posts. Thinking you might actually be mentally ill at this point.

>Your uncaring attitude towards one of the biggest companies in the world admitting to have conducted the biggest psyop in history is concerning, your even more uncaring attitude towards the most powerful person in the VR industry being the same one that lead advertising for Facebook and personally overseen the massive psyop that helped trump win is the only thing in here that can be called deranged

Facebook ads are conspiratorial psychological operations now? Dude seriously, get help. This isn't normal behavior.

>VR would have naturally developed a Quest 2 when it needed to and could, it’d also be a lot more organic, open and have a ton more & better games and a lot more competition incentivizing devs to improve, you act like a multi billion dollar company annexing the market and buying everything is the only way forward

This is mentally ill rambling. I don't even know what to say anymore.

1

Akashictruth t1_ja6d0iq wrote

Do you think the more ad hominems you throw around the more sound your argument(or lack there-of)? You are genuinely sad, anyone who sees how much you defend facebook would think you are part of it’s board of directors

I think you are just trolling, there is no way any human with real views and opinions would think like you so i will just close this off, have a good day.

1

BlueShipman t1_ja8kpvz wrote

> He pointed to the Trump campaign having run "the single best digital ad campaign I've ever seen from any advertiser. Period."

Wow, what a psyop

>"They weren't running misinformation or hoaxes. They weren't micro targeting or saying different things to different people," Bosworth wrote. "They just used the tools we had to show the right creative to each person. The use of custom audiences, video, ecommerce, and fresh creative remains the high water mark of digital ad campaigns in my opinion."

Whoa, this is pretty much a full blown psyop at this point.

1

NoidoDev t1_ja5ulzo wrote

It didn't take off, and there are enough gamers with money but they want games for their expensive hardware. Meta is a burden to the ecosystem.

−1

NoidoDev t1_ja5u3fl wrote

I think, they lured a lot of devs away from game development with loads of money and then used them for working on their meta thingy which goes nowhere. They're trying to make everything into one platform which they control and also everything geared towards mobile devices.

−1

Akimbo333 t1_ja24wyr wrote

Very interesting. Is this Open Sourced?

19

blueSGL t1_ja27gk8 wrote

You need to request access.

16

Akimbo333 t1_ja29201 wrote

Ok. How is it?

6

duffmanhb t1_ja2o0mz wrote

No idea... They only allow in published researchers.

4

visarga t1_ja2u514 wrote

But they documented how to make it by sharing paper, code, dataset and hyper-parameters. So when Stability wants to replicate, it will be 10x cheaper. And they showed a small model can be surprisingly good, that means it is tempting for many to replicate it.

The cost of running inference on GPT-3 was a huge moat that is going away. I expect this year we will be able to run a chatGPT level model on a single GPU, so we get cheap to run, private, open and commercial AI soon. We can use it for ourselves, we can make projects with it.

12

duffmanhb t1_ja2ugba wrote

I hope so. I'm still waiting for them to accept my invite. But soon as I get it, first thing I'll do is create some llama bots for Reddit and see how effective it is compared to GPT3 posting believable comments. If it's nearly as good, but can be ran locally, it'll completely change the bot game on social media.

3

FC4945 t1_ja2qzxt wrote

Meta but it's proof of concept and it's being done in February 2023.

1

NoidoDev t1_ja5t1pw wrote

This. Same question as mine. And of course no. The introduction, the hope, was fake and futile. For now.

1

Akimbo333 t1_ja5tx72 wrote

Well, from what I understand, this model was Multimodal. So it is much much stronger

1

Motion-to-Photons t1_ja29lm6 wrote

Dum question, but let’s say this time next year we are indeed running a 13-billion parameter LLM on our top spec home GPUs, how long would a response take? With images I’m happy to wait 60 seconds for a really good result, but would I wait that long for a reply from an LLM? Perhaps we are running 13-billion parameter models next year, but it might by be another 4 or 5 years until we would actually want to?

19

AylaDoesntLikeYou OP t1_ja2crc9 wrote

With stable diffusion they were able to drastically reduce their generation time to 5- 12 seconds (depending on the GPU) and they were able to reduce vram usage from 16gb to 4gb in less than a month.

These optimizations wouldn't take more than a year, they can happen within months. Weeks in some cases, especially once the model is running on a single device.

34

qrayons t1_ja375cg wrote

I don't know. It seems like the 13b parameter model is already the optimized version. Obviously I hope I'm wrong though.

2

visarga t1_ja2uz8e wrote

Apparently 13B models feel comparable with chatGPT on a 3090 card with 24gb vram (source). So it would be fast!

17

Motion-to-Photons t1_ja41xqc wrote

Wow! That pretty much answers my question, then!

Honestly, I’m not happy with this rate of progress. Many people are not smart enough to see through simple Facebook/TikTok/Instagram algorithms. They have no chance when confronted with weaponised AGI.

7

Bman1117 t1_ja2pjq4 wrote

Our version is better than the others but you can't play with it. Nice and useless...

14

SrPeixinho t1_ja2tkbw wrote

My girlfriend lives in Canada and no, you can't talk to her.

15

BlueShipman t1_ja483ez wrote

Yeah this is just stupid right now. I wish Stability would hurry up and start releasing their open source LLMs. It'll probably make all the closed stuff look stupid like Stable Diffusion did.

5

NoidoDev t1_ja5tgxx wrote

True, but others will replicate it. Soon. It's a peek into the near future.

2

leakime t1_ja37vhb wrote

All I want to do is walk around an AI generated VR world and talk to NPCs in real time. Holodeck is my dream.

14

SimpingForAI t1_ja3wldg wrote

We need open-source AI assistants on our own computers so that we can be guaranteed our privacy from the big corporations.

5

InitialCreature t1_ja586wh wrote

also the option to run it unfiltered and unjudgmentally for it to be truly open.

2

ReallyBadWizard t1_ja3n00e wrote

Just imagine the level of optimization an AI running your PC could do for you. Literally just tell it to create and write code or whatever and implement it. We really are at the tip of the iceberg.

3

agsarria t1_ja3qx0d wrote

Running llms on a desktop is something very interesting, but running on a phone doesn't make any sense... Just send a request and get the response, it probably is gonna be faster and much less battery demanding .

3

NoidoDev t1_ja5uunb wrote

With a home server, maybe. Corpo AI, no thanks. Also, it's more interesting for robots with bigger batteries. Stay at home with your robowaifu, therefore care less about your phone.

1

azriel777 t1_ja541fi wrote

This is cool to know it is possible to run things on a single GPU, but kind of useless since it is being locked down and not open sourced to the public. Really hope a company comes out that releases something just as good as CHATGPT, is open sourced and can be trained by individual users so we can create models that are focused on certain fields and uses.

3

No_Ninja3309_NoNoYes t1_ja2w92l wrote

I haven't read the paper, but my friend Fred says that they used a simple model to decide what goes into the training data. That would explain the 10x smaller size. Or one of us misunderstood. I mean, you could download the data in theory and grep for whatever you are interested in. Let's say psychology. Then get the code and GPUs in the cloud. You can crowdfund this if there's enough interest. I guess the more niche topics would be also the cheapest to do.

2