Rahul gangotri
CDCloudflare Developers
•Created by Rahul gangotri on 10/29/2024 in #vectorize
Quick question
also one more thing, i think its doable @garvitg
instead of hard binding on wrangler.toml for every index as we need many indexes so its not possible to dynamically add every index for the binding, can we have 1 extra argument in the sdk to mention the index name and do all the operation like
create index (i can use API for this one too), Query, Insert
6 replies
CDCloudflare Developers
•Created by Rahul gangotri on 10/29/2024 in #vectorize
Quick question
ok, thanks @garvitg , for now i'll make a workaround to create multiple indexes on demand to distribute vectors for all the users and keep a track on that myself so i can offer unlimited number of vectors for any user across platform.
6 replies
CDCloudflare Developers
•Created by Rahul gangotri on 10/29/2024 in #vectorize
Quick question
I am building a platform where i will be allowing my users to create memory and connect their own custom or any LLM and create threads to create RAG app, or anything that requires AI with or without memory persistence
whatever is there is okay for now, but the main limit is the vector limit for me on every index as i have set of users and if i just create 1 index for every user that it wont be unlimited.
second solution is to have each memory as a new index but that would be complex in terms of search query, then for every query i have to go though multiuple indexes to find suitable result and then rerank again, that will also lead to added complexity and delay.
i would love if you can just increase the limit of vectors per index to unlimited on my account? then i can just create multiple namespaces for my users and still search on same index without faster query time. and also provide an api to do namespace based filter, one or many NS at a time. along with metadata filter
also i need to filter on metadata without creating indexes if that's possible for my account?
i am just testing out how this works then i will be updating to worker paid plan on my new account that i will be using for this project.
6 replies