Can I have some questions? 1) What's the
Can I have some questions? 1) What's the best way to get all metadata from vectorize? For example i have 1000 topK i want to return 1000 metadata texts, right now limit is just 20 2) Is it good idea to have namespace per user, or i should go with separate vectorize per user? Thanks for help 🙂
2 Replies
Hi @Puliczek, thank you for checking in!
1. You can either receive metadata along with the vectors in the query response or by using the
2. It really depends on the number of vectors associated with each user. If you expect that each user would have several millions of associated vectors, OR if the total number of vectors for ALL users would exceed 5 million, then you should certainly create separate vectorize indexes for each user (https://developers.cloudflare.com/vectorize/platform/limits/). Otherwise having separate namespaces should suffice.
get-by-ids operation on a Vectorize index. At the moment, if you'd like Vectorize queries to include all of the metadata, the maximum supported topK value would be 20.2. It really depends on the number of vectors associated with each user. If you expect that each user would have several millions of associated vectors, OR if the total number of vectors for ALL users would exceed 5 million, then you should certainly create separate vectorize indexes for each user (https://developers.cloudflare.com/vectorize/platform/limits/). Otherwise having separate namespaces should suffice.
Thank you, @garvitg.
Yes, but I'd like to retrieve all metadata from 1000 vectors at once. I think getting D1 to assist might be the best option.
Yes, the limits are fine for me. I wasn't sure if it was a good approach, but now I know it is.