Azure Open AI preserve history and load instruction files
Hi all, need advice I'm working AI chatbot and want to preserve chat history per user.
What would be best way to implement this without using database. Is there better way than creating service which holds all chat history in list and registering this service as singleton?
Also my plan is to have storage account on Azure where I would put my instruction files on blob container and when creating initial message download this files from Azure and load them as user messages for open ai service. Is there better way to load files instead of loading them in constructor of AzureOpenAIService?
2 Replies
Either use JSON files or SQLite
I know you don't want to use "a database" but any file format you'll choose for this type of thing will automatically be considered a database
I will have instructions for ai model in file and will load file, file contains rule what ai should do in general, here I don't need to persist history in file just for duration of conversation.