Saw that somewhere HhHhHzhHmMmmmmmatrix xd

I think it will happen within 10 years - first Indie developers will make AAA games and soon after everyone can do it.

Yes.

Text to Video is already happening, and Text to 3D Environment doesn't seem particularly more difficult.

In many ways it may be easier, since 3D elements can be broken down into components and "understood" by an AI.

For example, a 3D room has a floor, walls which connect, a ceiling. Now generate varieties.

Or a 3D character: A body has known elements. A face has specific parts. Look at Unreals Meta Humans, which are ultra-realistic faces with feature sliders.

Much of this already exists within the game building and level building world. It's just been under-trained by modern AI practices.

NVIDIA is working on it, as are many others. I wouldn't be surprised if we see mind-blowing examples of this working in months not years.

More than what we already can do with codex?

Is here now just isn’t accessible

Probably won't be text, you'll just have a conversation with an agi, using ar/vr to direct aspects of the games creation in 3d space

Imagine Star Trek. 🤔

Text to 3D is already having the first method that I learned from, this AI from Google courtesy of Two Minute Papers

Yes

All the old school text based games could be revived with AI graphics creating visuals for what's happening

I'd think sooner at the pace of change we are already seeing.

I would love this so much!

Seems to be a good path forward for AI generating images

Yeah, no

Yup, wouldn't surprise me if someone is already training a large language model on unreal engine so you can just ask it to do something and it creates it for you in the engine. This is definitely a near term reality and by near term I'm thinking less than 2 years for individuals to create indie quality games.

You don’t think voice will be a means of communicating with AI systems?

I have a ton of non-fiction stories, that I'd absolutely love to bring to life, at moment's notice.

Sounds like a much better work-flow, than current game-dev methods!

Exited for this lucid dream/drug trip level of simulation

Well, at that point it really blurs the distinction between a 'game' (characterized by some constrained set of rules and goals) and more of an 'AI-generated experience'. Not that there's anything wrong with the latter, it's just a bit of a terminology issue.

And yeah, I expect that before the end of this century we will be able to jack into our own personal Matrix and experience pretty much any environment and narrative imaginable within the realm of human cognition.

It will not, the companies creating these technologies would never allow you the opportunity to create the products you imagine. they'll use aggregated data to sell you the products you've imagined.

Im sure we will see the equivalent of 1980s Atari AI generated games soon enough.

Yeah Codex isn't what he's describing. In OPs scenario the code would be hidden, you'd be building games visually and with your voice on the fly.

"Create a first person shooter. Genre is zombie, post apocalyptic. Okay, change the first level to an urban setting, at dusk....."

Etc etc. Imagine you have a super-fast game developer sitting at a desk and you're looking over their shoulder, giving instructions and feedback....

But it's faster than any human and you're INSIDE the game in VR, building it as you see it.

[deleted]

Yeah, the "input-to-output" progression I see coming out over time is:
* Text-to-text
* Text-to-image/audio
* Text-to-3D model
* Text-to-animation/video
* Text-to-interface/game
* Text-to-physical object (through 3D printing and other means)

There will be some overlap though, so this is not necessarily a strict ordering. And the "text" input could also be replaced with voice or some other modality. Image-to-game, 3Dmodel-to-physicalObject, etc.

That's what I was trying to say. Thanks.

Crazy that 4 of those already exist. Literally just ticking off boxes every month.

I'm more interested in text to will to live

Just to add a pessimistic take on that : I think we're still very far from that, this really sounds like something that could only be made by an AGI (for example anything that includes human interactions is basically mini turing tests if you want it to be realistic).

But I don't see a reason for it not to happen eventually, maybe in 20 years or so if we're lucky ?

> (characterized by some constrained set of rules and goals)

But a game can always be updated, along with those goals. AI will just make this process run in real time.

"Human: Please generate a new storyline focusing on Adragus the Wizard, I wanna know his backstory and what happened to his family!

AI: High quality free DLC incoming, wait a few minutes! ;)"

It'll initially be text, then voice.

Depends if you mean a fully fleshed AAA game or pong. We can probably already do pong. But the leap from video to AAA game is much greater than the leap from image to video. It will essentially mean the AI is capable of writing 100K+ lines of coherent code. So basically I don't think we'll get it until we get AGI.

“computer, i want to experience a plotline set in the world of the My Hero Academia anime where im a Nomu and im rebelling against my villainous masters and the heros help me become a law-abiding civilian. and i start living in a government funded grouphome for rehabilitated monsters. and i fall in love with a fellow monster.”

ERROR: COPYRIGHT INFRINGEMENT

“okay, um. do what i just said, but replace all the copyright-infringing elements with original ripoff material; as similar as u can get away with”

COMMAND ACCEPTED. CREATION TIME: 40 MINUTES.

“ok cool im gonna play my ps5 in the meantime”

I mean you can already speak to an AI lol xD

I asked this over at /r/gamedev and people was furious because "only people are supposed to make games" or "I enjoy the process of making a game so we don't want AI" and similar sentences. Completely disregarding the advantages AI could bring like faster production rates and cheaper games but yeah no, that isn't as important as them being the one making the product.

Oh customers don't want to wait 8 years for the next game? well too bad.

Star trek holodeck! But using augmented reality

It will be similar to how tony stark and jarvis interact to create things, able to grab objects, form terrain, adjust physics, move camera, etc in 3d space. Could even use a bci to communicate abstract ideas or visualizations and see them in front of you in real time. But before then, will probably be text or advanced game engine on a desktop

Right, text to "game".

Remember the Trek episode where we get to see Barkley's custom holodeck scenario with Deanna Troi's expy playing the role of the goddess of pleasure?

That kind of game?

The thing is, if the average consumer will be able to create what today is considered AAA, then game studios like Activision would be able to create games far beyond what is possible today, unless indie devs can come together and form an ethical studio

Yeah, pretty exciting! 3D models an animations are coming along faster than I expected.

Also, I like to think of some of these as grouping of lower-level ones.

• A video/animation is a coordinated sequence of images.
• An interface/game is a coordinated sequence of audio and image/model/animation output depending on user input (and also underlying game logic and values stored and managed through code, which is just text, which means it too can be generated).

At higher levels, I'm imagining things like simple code to more complex information architectures, business models, complex machinery instead of static objects (image-to-physicalObject is similar to animation-to-machine), and systems of interacting machines like manufacturing and transportation systems.

Ultimate goal: automated economy and natural resource management.

extremely unlikely and too pessimistic. It takes one person to leak a model, one group of people motivated enough - we'll get it sooner or later.

Yeah lol, just hop on git and download the Twitter algorithm while you're at it, absolutely delusional take. Stable AI is run by a hedgefund manager, Open AI is no longer open source.

Anyone with two brain cells to rub together can piece together how this is going to shake out. You should be screaming from the rooftops about digital rights management and data ownership right now.

Noone wants the twitter algorithm. Thousands wanted the NovelAI model. Motivated people can do anything

[deleted]

Your underestimating capitalism, there will always be someone who finds a way to make money off letting people AI generated games, And the fact midjourney lets you use images for commercial purposes proves you wrong

Are you imagining AI generated modern 3D games, what about really basic Atari/NES games, like sidescrollers or topdown games like pacman or gauntlet

I see it happening and I also see intellectual property holders having a meltdown. We are seeing that now with AI art. Quite a few popular modern artists are seeing AI art that they didn’t create and don’t own but that is based on their own unique style. What happens when you can tell an AI I want to use a CoD style game engine but set in middle earth and using stormtroopers riding pterodactyls as air support. The entire world of pop culture and human history can be appropriated and repurposed for game play. It is going to challenge the concepts of ownership.

Yeah Web Voice API is literally built into Chrome. Voice to speech is trivial at this point, and only getting better with systems like Whisper.

I know this is not really what you're talking about, but Character AI has some really fun ai-powered role playing games. You also have the ability to create your own games or characters if you want!

Unreal Engine 5 is literally free for individual creators.

This is an incredibly pessimistic and already factually disproven view....

I've seen it and I liked it a lot, I played it mostly in the adventure world, it's cool and I recommend it, but I think it's too restricted sometimes. I would like something that gives more freedom to play, something that I think the creators unfortunately don't like. I tried to create a coherent character but in the end I realized that the AI ​​wasn't trained for that.

Talking about that, did you see that they've added functionality that allows you to view screenshots in adventures? It is very cool

I think so, yeah. This whole field seems to be doing incredible things. I don't think it would be more than a couple years to have, at worst, a rudimentary model that can do this.

Natural language text-to-code https://youtu.be/Zm9B-DvwOgw

AI NPC conversation https://youtu.be/jH-6-ZIgmKY

text-to-3d models https://youtu.be/uM5NPodZZ1U

You've seen AI art, music and scriptwriting already no doubt.

The elements are all here, they just need to be polished and put together.

People who aren't paying attention are going to be blown away by how soon we have an engine that you can tell to watch particular shows, read particular books and look at a gallery of selected art, then build you a game overnight according to whatever half baked ideas you rambled at it.

Ai dungeon! Uses a GPT3 language model I believe for a “adventure” style text generator. It blew my mind a year ago. Seems like the community has dissolved a bit, with NovelAi, and now there seems to be ways to run text based “adventure” or story writing novels locally.

It used to have a rudimentary pixel art implementation, but knowing that novel ai developed a stable diffusion model it may have one now as well. I haven’t checked in a while

2042? More like 2024. AI progress happens so fast that game synthesis might be in a lab now.

I hope one day it can be like aidungeon but it generates everything in VR as you interact with the game world. That would be the dream for me.

If players can give the AI fedback about what they're experiencing in real time, it can learn what works and what doesn't for building 3D worlds/games for us to experience at a faster rate. E.G. We're hooked up to a feedback device that lets it know if we like what we're seeing. Or just a few buttons on the screen we can press to let it know what we think. Click on the object in the room that's out of place or looks weird and let it know that's not right.

Something I think about sometimes is "the infinite library", where you have infinite books, each book simply containing some sequence of characters.

Every conceivable book is in the infinite library, but finding anything is basically impossible. Somewhere in there is a book with your life story, all the works of Shakespeare, and every math solution, and extraordinary books which no one ever wrote. But there's no known catalog.

Diffusion models feel like a way to filter out most of the garbage(and likely a lot of good items too) and pointing to stuff that isn't pure nonsense.

Makes me wonder if we could train on NES roms or stuff like that.

Fucking stoked lol. Future of gaming is bright lol

Text to Game will be a huge, if a solo dev can create a AAA tier game that is actually fun to play, from scratch? That's when shit gets real.

Although I think AI completely generating a game from scratch is likely to produce a lot of mess and incoherence if it's not using AGI. In the nearer term, I would expect game developers to act more as directors, in the sense that they will assign particular tasks and modules to an AI, which the director will then stitch together into something coherent and compelling.

For instance, creating dialogue for NPCS might be a task of manually designing a dialogue tree, then using AI to generate the text, curating and pruning portions of it until it looks right, after which you'd generate your voices, facial animations and design of the NPC itself all via AI.

For a more level headed take :

Think about how complicated a game is. Enormously huge environments, behavior of npcs and objects fitting well defined rules, multiplayer synchronization.

So even with pretty advanced AI, getting A game that can be played is a very different ask from "give me a game like gta 5 but better"

Moreover, even if a machine could in fact give you a "better" knockoff of gta 5, without many people playing the game and giving the AI feedback on where to improve it still might not be a very good game.

The novelai model really just makes art for people that are down horrendous. The only thing it generates really well are comically sexualized anime women.

reminds me of this one video I saw of a Poketuber trying to use one of these AI art generators and the Pokemon they wanted to created turned out fine but every time they were trying to make the human characters and got a female one, she had an ample bosom or at least bosom focus from the picture's "camera angle" and one picture was a literal upskirt shot

you have to be so descriptive with it, I can imagine people thinking "screw this, I would rather just code instead" hahaha

underrated reply! good shit!

Just needs different and better training data

I would love to play The Passion of the Christ video game as the Mario Bros.

IMO, it will most likely require AGI. It is almost the same task as a fully automated software engineer.

In the mean time we have my game called AI Roguelite on steam to entertain us until then

Edit: some might wonder why it would take so long if we already have auto video etc. This only becomes clear when you start thinking about how to build this kind of game (i.e. what would AI Roguelite 2 look like and how would it be built). It is not enough to auto generate video or models or even animation. With those 3 we could get something like No man's sky that's much more visually detailed but not necessarily better gameplay. The game needs more info like what each attack/ability actually does, creative enemy abilities/behavior, what the effect of an item should be (which are often very open-ended and shouldn't simply be +dmg) etc. When all these are taken into consideration it basically requires AGI

Like AI Dungeon 2D?

Instant thought manifestation

It will be awesome in opening development to so many more people, but people are sleeping on upscaling old games and how awesome it will be. It's realistic that this can run in real-time and so will be highly customizable.

Just imagine playing games like Chrono Trigger or the first Metroid but they look as good or better than the best anime out there or Into the Spiderverse. So many well-crafted experiences that aren't worth playing for most right now, they can be made to look photorealistic or with personal artistic styles, but just generally look beautiful and crisp like modern graphics.

Same with old movies, even sports. Lots of sports classics locked away because it looks like it runs on a bad potato. So much potential to look for the best footage of sports legends and have UHD of the best of their career. Too laborious by hand, but for a machine it's trivial once the various parts can be hooked together. As long as it's digitized, it can be rebuilt. We have the technology. Well, soon.

It can even go wilder, like old movies reimagined. Just a bit or a lot. Like what would Gone with the wind look like if Tarantino directed it? Or lightly update the graphics and styles to something more modern in terms of cinematic style and camera work. Or replace an actor. That one will be a teensy bit controversial.

Lots of potential for people to do remakes of series or movies. Like remove an entire plotline from this series, and this character dies in season 2 instead of continuing. It's the same series, just that one mistake is entirely gone. Or reworked, the timeline presented in a way that makes more sense. Or remove all the filler episodes. Instant remix from a simple instruction. Unlimited potential.

No. Text to image is very different in complexity than creating a game which has a story telling, different levels, game mechanics, level balance.

Can AI help in creating a game in some parts like texture design? Yes.

I think any game ever made could be reinvigorated by AI, in any way you’d like. It’s going to be a very interesting future!

20 years is a stretch imo. AI advancements will increase exponentially in the coming years. We had DALL-E 1 like 1-2 years ago creating flawed diffused images ans now we’re already talking about stable diffusion for videos. All that in just two years.

Yes. I'm a game designer and in part it's already happening.

I'm just going to leave this here.

SCIENCE BASED DRAGON MMO

i don't disagree with any of this.

but we need more.

we need animation, post processing, ui/ux, netcode(multiplayer), level design, particle system, etc....

we're within a decade or even 5 years of games where ai does the heavy lifting in a few categories.

we're at least a decade from an ai game ENGINE where text-developsAnEntireGame

edit: for context im thinking AAA title/popular indie quality games. i'm sure we're close to 2D asteroid-esk ai text-game like only few years

By 2026 you’ll be able to generate a simulation of any environment, real or fiction, and populate it with NPCs of any kind. You want human NPCs? Sure, they’ll all be instantiated with a next-gen language model and can carry a unique conversation indefinitely. You want never before seen alien species? Why not, go ahead and breed & evolve them while you’re at it.

Yeah I'd like txt to Game with Unreal Engine lol! I'd make:

Megaman Starforce 4 Tales of Rebirth, Symphonia, Abyss, and Innocence remakes Infamous second son 4 aka infamous second son 2 And an Assassins Creed set in the American Civil War!

Yeah, I said 20 years thinking about 2030-2035 but gosh we're already almost in 2023

Agrees. Any old NES game, atari, whatever system, could be run through a powerful AI that stylizes it anyway you want.

Right now you can create a game from text using your natural intelligence. And within a few days. Look at Inform 7.

r/interactivefiction

Unreal 5 isn't a magic idea stealing machine you have to trained skills, you're delusional.

Did you even read what I said? They don't need your ideas, you're already posting everything they need to know about you. Midjourney will be bought and made private/barred away, as with all things that capitalists see value in. Capitalism is quite litterally the system of private ownership, they aren't going to share.

Elon musk just paid 44 billion dollars for the twitter algorithm, you are absolutely deluded on silicon valley buzzwords.

What in the world are you rambling on about, midjourney is already a private company, and people have to pay to use it if they want to make images they can then use for their own commercial purposes,

Do you expect AI generated images/video etc.. To be free, there's already a lot of people paying midjourney, theres no reason to think in five years when AI can make videos people wont pay for that

I'm not saying privately owned you clown open AI was bought and made closed source ages ago, I'm saying it will be sold to someone else and barred away from use from people without a LARGE amount of base capitol.

Did anything I said imply I expect it to be free? I think you might struggle with reading comprehension.

You dont win debates by getting angry.lol its pointless continuing this, please dont respond.

Imagine letting an AI loose on Dwarf Fortress 👁️👄👁️

Yeah its only a matter of time before we see that happen, I think

[deleted]

• BCI (brain signals) to human context and behaviour.

Imagine how detailed and massive could this dataset be.

[deleted]

I mean if text to game exists then you will have to write a whole book or the AI will fill in random generated parts…..and even that is iffy

Yeah if you ask “ a game set in the Roman Empire” it will just generate random npc and buildings you need to get into detail

Not enough detail at all

GTA v still looks good and was made like 10 years ago and not much of gaming has changed….npc are still shit….worlds are still small definitely way way more than 10

Oops you got hacked now you will be forced to live in a world made out of poop for eternity..

Bruh gta v was made in 2012 and gaming hasn’t changed much at all and you think in 2026 we are going to have this…..

With enough time, resources and will, everything will be possible.

I wouldn't be surprised if the next iteration of text generators (in a few months) have the ability to do fully fledged adventure text games by writing the story first, with all it's possible outcomes and links between the text segments, then putting the segments inside a traditional text adventure shell program. Even if that AI then pipes that story or story portions into another AI text adventure software generator to output the program. If passing the Turing test is a few months away as hinted, then these would be possible and refined by the end of next year.

As to more advanced games? We'll be seeing feedback loops and exponential returns over the next few years that will see the development of AI generated games parallel the development of the history of video games, but in accelerated time; whether this will hit open world VR levels before we hit AGI (and everything accelerates) will determine if it is an exponential curve or a hyperbolic one.

AI will change that rapidly is my point

In another thread people are speculating about proto agi in 2023.

I'm not sure if they realize that a proto agi should be able to do what you are asking, among a lot other things.

A proto agi should be able to create every kind of software and iterate over it according to your instructions.

When will this be possible? Hard to say but likely in the next 20 years.

there's people who'd be willing to wait if quality's worth it

Absolutely.. this could probably be done now honestly