Viewing a single comment thread. View all comments

timscarfe OP t1_ivowy2o wrote

This is not true at all, and not relevant for this discussion

Neural networks are finite state automatas (FSAs), they are very simple computation models (far simpler than normal computer programs, which are at the top of the chomsky hierarchy i.e. Turing machines)

See https://arxiv.org/abs/2207.02098 for a primer "Neural Networks and the Chomsky Hierarchy"

2

Philience t1_ivoywj3 wrote

What part do you think is false?

What do you mean by "simple"? Trying to predict each state of a neural network is almost impossible. Neural Networks are usually seen as prime examples of complex cognitive models (and are not computational models). Even though your algorithm that emulates a neural network in a computer, of course, does computation. Neural Networks do not multiply matrices. Your computer does.

I admit whether they are chaotic or dynamic systems depends on the model and the scale of the model. And most models might be none of the above.

1