Keras is a good tool when getting started imo. But eventually it’s better to switch to PyTorch because it’s more pythonic and although tensorflow used to be the deployment standard PyTorch has caught up and add to that tf doesn’t even have a team working on it anymore iirc since everyone moved onto jax. I will say tho PyTorch can be very frustrating to work on initially because a lot of the internal optimizations that keras does are absent in PyTorch. I’ve never used PL tho.

Comparing current AI to AGI is laughable. To quote Yoshua Bengio : “current AI algorithms are dumber than a dog” iirc that’s what he said in 2021 in a video interview. None of the leading researchers in the field be it LeCunn or Bengio or Parikh or Hinton etc think we are remotely close to basic human intelligence. Comparing GPT to a human is stupid. It literally parrots information it memorized. Attention and self attention aren’t magic. We are at a stage when AI or rather PI is good enough to understand some context of for some words because it has seen it billions of times. In fact , we aren’t even at a stage where any model can actually completely not hallucinate random things that aren’t true. So it technically doesn’t even understand true context. Ask any worthwhile researcher in the field and they’ll tell u how this article is complete garbage.

There’s an entire branch of ML that focusses on scaling. Irina Rish is one of the big names behind the “scale is all you need” motto. Is she right? Maybe! But even she’ll tell u that we aren’t within reach of the dumbest human being when it comes to intelligence.

Quick question is PyTorch lightning a better PyTorch or is it more ‘streamlined’ (meaning high level) like say keras for tf

Wonder why if so NNs are so much better on unstructured data while being trickier and in general more useless on structured data compared to tree based classifiers and boosted classifiers.