We have documents which we’re ingesting into pinecone and querying with questions.
Some times we need top-3 answers, some times we need top-10 answers. This is because there is information that is scattered between multiple parts of the document.
The document could be “Sarah’s food log”. A certain question could be “what is the fruit that Sarah ate” - we need to return all results of the fruit Sarah ate, not just the top 3.
Do you guys have any way to have a dynamic sizing of k in the top-k queries?
Would appreciate any help in this!
Thanks a lot.