Would you be able to tell if I didn't?

No I mean what is consciousness?

What does that mean?

Can we test for consciousness?

I can't think of why we would be different from a very complex computer.

It's a degenerate case, not something anyone should do. If you include Y in your input, then overfitting will lead to the best generalisation. This shows that the input does affect overfitting. In fact, the more similar the input is to the output, the simpler the model can be and thus the less it can overfit.

Well selection is part of engineering, is it not?

https://sciendo.com/article/10.2478/cait-2019-0001

Yes, if the features include the model's target output. Then, the overfitting would result in the model outputting that feature as is. Of course this is a useless solution, but the more similar the features are to the output, the less overfitting will be a problem and the less data you would need to generalise.

A sequence length of 6250 is massive! It's not just 6250*6250 since you're not multiplying one float per pair of sequence items. You're multiplying the key and value vectors together per pair of sequence items, and this is done for every attention head (in parallel). I think you're seriously under estimating the problem.

What transformer is this which accepts a sequence length of 6250?

Parameters are a tiny portion of the values in GPU. The number of activations grows quadratically with sequence size.

How do you determine the causes of a phobia?

It's for reinforcement learning to keep the model exploring possibilities.

I want the output to remain a proper distribution.

What's this about del attention?

It needs to remain a valid softmax distribution.

That will just make the model learn larger logits to undo the effect of the temperature.

Alpha Go does not use a large database of moves. If anything the reason why winning Go was so impressive is because there are way too many scenarios to solve it the way you're describing. It learned to play by practicing against itself using reinforcement learning.

Is delayed pain perception a problem for very tall people such as those with giganticism?

How do they get synchronised? Is it just a matter of there being discrete time steps when the signals get processed? Do the time steps get longer as you grow taller in order to accommodate the longest nerves?

Is it that different from using calculators in primary school mathematics? I'd like to say that we need to come up with a higher level task that computers can't do for assessing students but I think we'll run out of options in a few years. Better to just make it a point that, while it is possible for AI to do a student's job (in the near future), it is still important that the students learn to do what the AI can also do. Unfortunately that means using in-class tests only.

Usually it's whatever the experimenter likes using together with a little tuning of the numbers.

I'm stuck wondering if there has ever existed a game that is available on any platform except PC.

Is what you do a translation from specification to code? What is your profession exactly? How have you been doing this task before deep learning was a thing?