Chat History, Memory and Messages
I have a general usage question for runpod; when I open the web UI, under Parameters > Chat history I can upload a chat history .JSON. Now, when I uploaded it, how do I make the AI Chat actually use of it, so I can continue this conversation? Another question would be where I put the stuff that I want the AI to remember at all times. And is it possible to edit messages?
1 Reply
@UltimateTobi I'm assuming you're using text-generation-webui?
As long as the messages appear in the window under Chat they will be considered by the AI, up to the context limit (e.g the "truncate the prompt up to this lenght" slider, if it shows 2048, it will consider the most recent 2048 tokens in the chat window, minus any tokens being used by the character tab, the system prompt, etc.)
For stuff that you want the AI to consider at all times, that would need to be in the Character tab as well.
If you're using AI chat I would actually recommend installing Sillytavern locally as it gives you way more options for interacting with the AI https://sillytavernai.com/, you can just use the oobabooga connection method and connect to the API at https://5xyhvtuv700jfl-5000.proxy.runpod.net/ (just swap out your pod ID in the URL)
You can edit the most recent message in oobabooga only, it's clunky, you need to type out what you want the message to be, and click replace last reply. ST is much more intuitive and lets you edit any reply at will
admin
SillyTavern - LLM Frontend for Power Users
Home - SillyTavern - LLM Frontend for Power Users
Explore SillyTavernAI - a cutting-edge text generation AI interface for interactive chat and role-play. Create your own characters or engage with community-created ones. Features include individual and group chats, prompt crafting, mobile support, chat bookmarks, a customizable UI, and extensions. Available for Windows, MacOS Linux, and Android....