airduster_9000
airduster_9000 t1_j95nbix wrote
Reply to Update on Deepmind’s Gato? by Sharp_Soup_2353
https://www.deepmind.com/publications/a-generalist-agent
Published
November 10, 2022
Abstract
Inspired by progress in large-scale language modeling, we apply a similar approach towards building a single generalist agent beyond the realm of text outputs. The agent, which we refer to as Gato, works as a multi-modal, multi-task, multi-embodiment generalist policy. The same network with the same weights can play Atari, caption images, chat, stack blocks with a real robot arm and much more, deciding based on its context whether to output text, joint torques, button presses, or other tokens. In this report we describe the model and the data, and document the current capabilities of Gato.
Conclusions
Transformer sequence models are effective as multi-task multi-embodiment policies, including for real-world text, vision and robotics tasks. They show promise as well in few-shot out-of-distribution task learning. In the future, such models could be used as a default starting point via prompting or fine-tuning to learn new behaviors, rather than training from scratch.Given scaling law trends, the performance across all tasks including dialogue will increase with scale in parameters, data and compute. Better hardware and network architectures will allow training bigger models while maintaining real-time robot control capability. By scaling up and iterating on this same basic approach, we can build a useful general-purpose agent.
airduster_9000 t1_j8w7omt wrote
Reply to comment by Staple_Diet in [OC] Which Political Groups did Former FTX Executives Donate to? by coingecko
All donations to republicans was "dark/hidden".
"“All my Republican donations were dark,” he said, referring to political donations that are not publicly disclosed. “The reason was not for regulatory reasons, it’s because reporters freak the fuck out if you donate to Republicans. They’re all super liberal, and I didn’t want to have that fight.”
Bankman-Fried’s undisclosed donations were made possible by the supreme court’s 2010 decision in the Citizens United case, which made it easier for donors to give large amounts of money anonymously and has led to more than $1bn being poured into federal elections since 2010."
airduster_9000 t1_j8w7j03 wrote
Reply to comment by Evil-Abed1 in [OC] Which Political Groups did Former FTX Executives Donate to? by coingecko
>FTX
“I donated to both parties. I donated about the same amount to both parties,” Bankman-Fried told the crypto commentator and citizen journalist Tiffany Fong.
"All my Republican donations were dark,” he said, referring to political donations that are not publicly disclosed. “The reason was not for regulatory reasons, it’s because reporters freak the fuck out if you donate to Republicans. They’re all super liberal, and I didn’t want to have that fight.
Bankman-Fried’s undisclosed donations were made possible by the supreme court’s 2010 decision in the Citizens United case, which made it easier for donors to give large amounts of money anonymously and has led to more than $1bn being poured into federal elections since 2010."
airduster_9000 t1_j8iawyz wrote
Reply to comment by T1Pimp in Study on former citizens of East Germany sheds light on why people may choose deliberate ignorance by chrisdh79
Yes - I immediately had the same thought. Its rare religions people want to talk about their religion, its history, its purpose, its meaning and what their beliefs really are.
But this is only a thing because people are almost always introduced to religion when they are children and accept everything as the truth no questions asked.
If religion was introduced as another "theory" about life/world/society when you are 12+ like most other theories (that are actually based in science and observation) - instead of being presented as "the ultimate truth" to a clueless child from its parents - religion would play a much smaller part in the world.
airduster_9000 t1_j4xftiz wrote
Reply to comment by KruppeTheWise in Apple Delays AR Glasses, Plans Cheaper Mixed-Reality Headset by GadnukBreakerOfWrlds
You might enjoy: Hyper-Reality - AR with ads and gamification (on speed)
airduster_9000 t1_j2mrgtl wrote
Reply to comment by Akimbo333 in Why can artificial intelligences currently only learn one type of thing? by ItsTimeToFinishThis
CLIP is the eyes that let it see images - not just read text and symbols.
​
GPT = Generative Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. Given an initial text as prompt, it will produce text that continues the prompt.
CHATGPT = Special trained version of GPT3.5 for chat.
DALL-E = DALL-E (stylized as DALL·E) and DALL-E 2 are deep learning models developed to generate digital images from natural language descriptions, called "prompts".
CLIP = CLIP does the opposite of DALL-E: it creates a text-description for a given image. Read more here: https://openai.com/blog/clip/
airduster_9000 t1_j2mg9rc wrote
Reply to comment by Ortus14 in Why can artificial intelligences currently only learn one type of thing? by ItsTimeToFinishThis
People assume that GPT4 might be multi-modal- and be able to handle more than juts text. Since its OpenAI - combining GPT, CLIP and Dall-E at some point seems given.
airduster_9000 t1_ire1nrm wrote
Reply to “We present 3DiM (pronounced "three-dim"), a diffusion model for 3D novel view synthesis from as few as a single image” by Shelfrock77
Guess the 3D budgets in game development just downsized.
airduster_9000 t1_jef4eu9 wrote
Reply to comment by agonypants in Resistance is Mounting Against OpenAI and GPT-5 by BackgroundResult
Its gonna turn into a security/defence-issue, if it haven't already.
You can not stop developing or using the most powerful tool (for everything) in the world - unless your advisory do the same.
If you look at the world right now its not exactly looking like world leaders will sit down and agree on anything. There is zero trust and willingness to co-operate because no-one has the same goal it seems. One part of the world still dabbles in versions of either autocracy or theocracy, while the other part is trying to make democracy not break down as a result of un-regulated capitalism, greed and soon climate change.
AI is gonna ignite change.
Lets hope its good - and not just more efficient killing tools like we are already seeing drones becoming in all conflicts.