Viewing a single comment thread. View all comments

blueSGL t1_j4ejzxn wrote

after seeing https://phenaki.video/

hard to say, ask me again when we see the next generation that surpasses the above.

no way to tell how easy temporal consistency is going to be, bad temporal consistency will relegate it to youtube and 'b-movie'/'low budget TV'

This is not like moving from the 80's into the 90's where bad CG was the best they had and so it was used. This needs to beat out the best of the best CG graphics otherwise the movie will be panned for shitty effects.

it could go through a period in comping and effects. Stuff like 'style matching' two clips that sorts out the lighting and color grade, or adding muzzle flashes and squibs by painting a mask on a keyframe and let the AI handle the rest, so adding to existing structure rather than making it all up wholesale

I suppose soon we'll be seeing a 'whisper' like AI to do auto Audio Description on scenes and acting direction, to caption existing films. (using existing AD could be a good contrastive learning technique)

1

banned_mainaccount t1_j4fnhxr wrote

i don't know about this phenaki thing but imagen video of Google is way way better.

1

blueSGL t1_j4gkxvd wrote

imagen does not allow for chaining together prompts, phenaki (also google) does.

If the question is about being able to create full movies then phenaki would be the tech needed to build on because it allows direction of entire scenes via temporally consistent context aware chaining rather than individual shots of concepts

2