Viewing a single comment thread. View all comments

kvutxdy t1_j9l7on1 wrote

Universal approximation theorem only states that DNN can approximate Lipschitz functions, but not necessarily all functions.

2

VirtualHat t1_j9loi32 wrote

It should be all continious functions, but I can't really think of any problems where this would limit the solution. The set of all continuous functions is a very big set!

As a side note, I think it's quite interesting that the theorem doesn't include periodic functions like sin, so I guess it's not quite all continuous functions, just continuous functions with bounded input.

4