Submitted by Ok_Sea_6214 t3_11d1a0j in singularity
I recently argued that with all these new AI technologies, it would be a matter of time before someone put them all together (prompt to script, text to image, text to audio, prompt to voice, image to video) to create full sized tv shows and movies. I was thinking of live action, but it seems it has now been done for anime.
An FX studio famous for its YouTube channel, called Corridor Crew, seems to have cracked the code, turning live action into a full on anime episode. And while the title of "Did We Just Change Animation Forever?" sounds a lot like clickbait, they might actually have done just that: https://www.youtube.com/watch?v=_9LX9HSQkWo
They actually didn't use that many new AI technologies, mostly just turning live action into anime frame by frame with Diffusion by locking in the style. But you can see the Singularity effect at work, because they worked this out in just 3 months. They also built on the efforts of other creators, who found simple solutions to existing problems (like flickering), to piece by piece figure out the right way to leverage this new technology into something usable.
This is a revolution for the anime industry, who instead of hiring talented animators, can simply turn live actors into anime with the right AI model. Even better, they can use existing films as a basis for new ones, for example the Vampire Hunter D movie used as a basis here for more releases. The studio that owns it could train an AI on the movie (and other movies in a similar style, like Magnetic Rose) to copy the drawing style, but also the script, the voice acting, the action pieces... to generate infinite amounts of animation, scripts and voice copies in that exact style, allowing them to create sequels with the exact same actors and styles, or spinoffs in the same style but with completely different characters.
At most one would have to give the AI some direction and fine tuning, with live action doubles or rough drawings (which AI can already turn into detailed designs with a simple prompt). The way a director might give prompts to his actors or animators, directors would now only need to prompt the AI to create the animation they want and how they want it.
It's interesting to note that Netflix cancelled a lot of animated shows recently, even ones that were in full production. Which makes me wonder if it's because they saw this trend coming and realized it would be cheaper to wait 6 months and have the AI do it instead. Because Netflix is posed to be the biggest benefactor of this new trend in the short term, having an established and paying audience, as well as the funds and vision to jump on an opportunity to become a market leader before Pixar and the Anime studios figure this out.
epSos-DE t1_ja6dwgv wrote
IF they play it right , then the artist will paint sample images for the Ai, and the ai will do the hard work of painting the rest.
Basically anime could reach better value with less effort.