Viewing a single comment thread. View all comments

Akrenion t1_j011yxv wrote

Reply to comment by midasp in [D] G. Hinton proposes FF – an alternative to Backprop by mrx-ai

U-net is specifically designed for backprop. It the skip connections are helpful for bp. We might need to rethink architectures for other approaches as well.

3

ChuckSeven t1_j016l2h wrote

That's actually a fair point. The optimisation lottery if you will. Where architectures are biased because they are designed around the algorithms that can be scaled and have shown to "work".

2