Maybe an even better idea is img2psd. It would be easy to do unsupervised learning for this. Just start with noise or a random image in a PSD file, make random changes like adding layers, drawing lines, adding text, etc, then output the corresponding PNG.

Then, you tokenize the PNG and the PSD files, and use the PNG as the input and the PSD as the output for the training data.

Could make a shit load of training data effortlessly that way.

That way we can use the current prompt to image solutions and just plug in the resulting image to this new model to output a PSD.

I’m not sure how well it would work, but it would be cool to try. Maybe it would also need some supervised data as well.