Update: after a few hours of weekend-hacking I've got
@OpenAI's chatGPT using all of English-language
@Wikipedia by providing the text of all articles as source material using a huuge
@pinecone
vector database!
I'm happy to report that it successfully answers
@nntaleb's question about the battle of Amioun without any bullshitting, as my previous local test did... (this one
nitter.app/StephanSturges/s…… ) and it also works in a much more graceful manner as a plugin because the "agent" which you are conversing with can make the decision to source / not source additional content based on context.
The structure that
@openAI has built for plugins is really clever and opens up a world of possibilities...
I really think the future of LLMs is in chaining interactions with external sources, and vector DB ones like this that are controlled, maintained and updated by a trusted source play a huge role in making that a valuable system. Stay put for a link to the demo plugin ASAP 😄
@bentossell
And don't forget to support the Wikimedia foundation for all the great content
donate.wikimedia.org/
So this is fixed now,
@nntaleb: I've added ALL of wikipedia to chatGPT using a
@pinecone vector database ! 😄
The AI may not be "smart", but now it has about 58,049,701 pages of knowledge to draw answers from.
... public link coming very soon.