Viewing a single comment thread. View all comments

chatterbox272 t1_ivjvhno wrote

Pytorch does have lazy layers natively, which also don't require known input channels. You just have to do a dummy pass with them after you create a model to init them

13

KingsmanVince t1_ivk562i wrote

Where can I read more about this "lazy layers"?

3

gahaalt OP t1_ivk66uu wrote

Here.

It is just like the standard layer, but retrieves the necessary input shape during the first forward call.

You can use lazy layers in Pytorch Symbolic too.

10