AllowFreeSpeech

AllowFreeSpeech t1_jeevp3b wrote

What bothers me is that most researchers don't care to use any model compression or efficiency techniques. They want others to pay for their architectural inefficiencies. IMO such funding could be a bad idea if it were to stop competition of neural architectures, and a good idea otherwise.

For example, is matrix-matrix multiplication necessary or can matrix-vector multiplication do the job? Similarly, are dense networks necessary or can sparse networks do the job? Alternatively the funding can go toward the engineering of optical and analog hardware that is significantly more power efficient.

3

AllowFreeSpeech t1_j1gbxjx wrote

Numba is rubbish because they don't tell you how many unreasonable errors you will encounter using it (a lot) for anything that is not a very trivial function. That's despite reading its docs in detail. It is overrated.

1

AllowFreeSpeech t1_j1et95s wrote

Free speech doesn't mean you can post nonsense or garbage or foreign-language materials. Free speech does still require you to be on-topic and stick to the language in use while in a public forum. Free speech means the freedom to post reasoned disagreeable opinions, but only those that are on-topic and are in the established language of the forum.

Use your head. If I go to a Chinese forum, and start posting in Japanese, how welcome would I be there...

2