Hi, are there plan to increase the topk
Hi, are there plan to increase the topk limit of 20 with metadata filtering? With chunked data a limit of 20 is severely limiting, especially for paginated search experiences.
2 Replies
Increasing topk limit with metadata and values pass 20 count will significantly increase latency, because it incurs additional subrequest to R2 for every metadata/value pair. We would need to add a pagination to search results. Does something like this will work for your use case where you would need to perform separate API call for every 20 metadata/values?
My use case revolves around web content, where the number of chunks varies depends on the content length and query. So in some queries topk 20 would only return a couple docs where in others it would return up to 20. Most services offer at least 1K topk and are highly performant. Pinecone offers up to 10,000.