Prior Response Recall | Voters

Prior Response Recall

planned

Ethan Cohen

It would be great to have the ability for the bot to remember prior responses in the conversation so that I can have a more fluid discussion. Currently it can't retrieve prior responses or at least it's saying that it can't

August 25, 2024

Ethan Cohen

endu what if I don't want to use this with bot creation. I don't want to create a bot? I like to chat with websites

endu

Ethan Cohen for that we're working on adding features from specific AI models that allow for longer context windows. This, along with using the anthropic caching option, should improve how well the AI retains context.

Siddhartha has more insights on this, but we're eager to implement these changes as soon as possible.

Siddhartha

Hey Ethan Cohen, if i get it correctly, you want memory of some sort, where the bot remembers what you had last conversed with it? From old chats?

endu

marked this post as

planned

endu

Ethan Cohen We're working on improving this feature with a new backend for bot creation. Once it's live, you'll be able to test it out and let us know if it solves the problem.

Ethan Cohen

endu Not exactly. I think you hit it more on the increased context window. I would like for the bot to remember the entirety of a conversation within the current conversation. For example, if I'm chatting with a bot for 30 minutes, i want it to be able to recall what I had discussed with it at the beginning of the converation. Memory of a prior conversation would be a nice-to-have but isn't the main goal.

endu

gotcha Ethan Cohen, Siddhartha had also conveyed the same to me... and we had a brief discussion, it can be done but will be some decent Tech effort, so once our existing things are shipped we will implement it - add memory to chatbots & more context for the bot to respond to your queries, cheers :)

Siddhartha

Ethan Cohen , have there been chats where it forgets those messages? Actually we do use RAG in our chats, so theoretically they should be infinite. We are bringing some big improvments to our RAG very soon, so they should help here but do let me know if this context thing is not working too well in long chats.