We’re using Pinecone vector DB and found it amazing!
However, we’ve got a problem using query API:
When we query for results, can we set the offset parameter of returned result list?
In our use case, we’d like to find the top_k = 1000 similarity results of a vector but we don’t want all the 1000 results included in one return; instead, we would like to fetch them in pagination(say 100 results per page, 10 pages), get 1-100 results in the first fetch, get 101-200 results in the second fetch. So we can have a quicker responsive UX without fetching unnecessary 201-1000 results in case user probably found the answer in the second fetch.
Could you please kindly suggest how we can do the “pagination” with the query API? Thanks.