Submitted by Lesterpaintstheworld t3_11attqx in singularity
MrTacobeans t1_j9vzw1p wrote
Why are you building this based on a closed API?
You could eventually find something in this adventure and openAI could be like woah let's not go there and block/ruin the work you've done. There are multiple open source models that can be worked into the kind of flow you are creating.
On a side note though leveraging GPT-3 to create even a proto AGI seems incredibly unlikely. If it was possible it would likely be in the news already. You mentioned yourself the memory limit. That's a big chunk of the issue with current AI. Can't keep a "sense of mind" going when half of it is getting deleted every few prompts
Lesterpaintstheworld OP t1_j9w529n wrote
The engine to generate token can be changed at any moment. Actually I'm looking forward to being a able to plug it on GPT 3.5 / 4. Also it could be replaced by an open-source counterpart, I am just not aware of any at the moment.
I think no one really knows we're AGI will emerge from. But even having an agent that can be an helpful assistant, even without the "AGI" part, would be quite the success for me. Business applications are numerous
Destiny_Knight t1_j9wof0u wrote
Honestly, it's already a sort of premature AGI. It can do any task you throw at it if you teach it correctly. It will do it poorly, but it will do it.
MrTacobeans t1_j9xi9n6 wrote
If you are paying for the API something like "RWKV" might be an alternative hosted on a GPU Cloud provider. The model is currently only at 14B parameters but technically has "unlimited context" which in theory is probably not actually unlimited but for what I saw in your use case it might be worth looking into
Viewing a single comment thread. View all comments