Yup, agree completely with your second point. The user experience, state and design of Mastodon is substantially less appealing.

On the drama matters, I personally do not care much for this, trying to avoid it like the plague.

Wow, why do people downvote this?

Is it a must every researcher should be an activist?

What if you just want to be left in peace, doing the research you enjoy?

Honestly, and this might be a completely wrong bet here.

Nothing will change, ML Twitter will stay ML Twitter.

Not at all.

There are in fact plenty of people who hack together something, a Frankenstein of OS-code in combination with other work found in githubs.

Its just hard to innovate if you're bound by the limits of your own understanding of whats going on. Not impossible, just immensely harder.

To be fair, I understand your motivation, I've had similar reservations.

However, the amount of boilerplate code I've been writing (DDP, train/evals, tracking metrics etc.) has been shrunk by a huge amount after switching to Pytorch Lightning.

When you are measured by your efficiency in terms of hours spent, I'd definitely argue for simplifying things, rather than not.

Well, daily.

But I do research.

While you can solve a lot of problems with out-of-the-box models and a bit of fine-tuning, solving problems in a new way often requires custom/new models.

This.

I guess that's whats remarkably fascinating by these models.

Albeit, in essence, you are putting a prior on the training set, thus there should be some limit to the manifold from which samples are generated.

+1 - Lilian Weng is straight 🔥

Being pedantic is at least not a pre-requisite.

Normalization is just centering and standardizing the data. Which these researchers are fully aware of.

Does that mean you suddenly transform Poisson distributed data into Gaussian? No.

Is it a big mistake to name it as such, ahhh, I don't know. Is it a measure of their mathematical ability? No definitely not.

Does it tell something about the level of pedacticity (i don't even know if that's a word) of the person? Maybe.

I'd argue becoming successful in this field you can go many ways, one of them may be very specific and T-person oriented (like measure-theory for instance), other ways may be more rounded and broad based. Whatever works for you.