Viewing a single comment thread. View all comments

dancingnightly t1_ja2lfup wrote

Reply to comment by davidmezzetti in [P] Introducing txtchat, next-generation conversational search and workflows by davidmezzetti

Is this current version mostly RAG + WebGPT semantic search to GPT answer, then?

Big fan of your recent work.

2

davidmezzetti OP t1_ja345mn wrote

Thank you.

This application is RAG with a local vector index combined with a LLM from the FLAN-T5 series of models.

The whole solution can be locally hosted with no remote runtime API dependencies.

1