Viewing a single comment thread. View all comments

SuperSpaceEye t1_iruxijm wrote

Reply to comment by Saerain in Generation of high fidelity videos from text using Imagen Video by Dr_Singularity

The video generator only creates video at 24x48 pixel resolution and 3 fps.

2

Mr_Hu-Man t1_irv0ny6 wrote

….what’s that got to do with the original comment?

8

SuperSpaceEye t1_irv0w3d wrote

It's "dreamlike" because it originally generates at such low resolution.

1

kasiotuo t1_irv6lx4 wrote

The low resolution isn't the only thing tho, it's also the morphing imagery

10

-ZeroRelevance- t1_irvla8f wrote

That probably comes from the temporal upscaling. As they said, the initial video is only 3fps, so they’re basically synthesising 7 frames for each actual frame given. It’s no wonder it’s going to morph. If it began with a higher temporal resolution (initial fps), then it would likely be much more coherent.

2

darthdiablo t1_irvot21 wrote

All tech start somewhere. This will improve over time.

5

Saerain t1_irvzawu wrote

Yeah, that may be an important point here actually. I'm reminded of how the imagery we are able to currently read from a live brain was about 12x12 last I checked, and dreams themselves are essentially upscaled interpretations of low resolution noise already.

1