Fetching data by a list of IDs efficiency issue

Search, No Filter
, ,
3

Hi @zeke_pinecone ,

The situation is that we have two services that require the same search results. Initially, I was using two identical vector searches to obtain the data. However, since the search results are not guaranteed to be identical (as discussed here Pinecone return results consistency - Search, No Filter - Pinecone Community), I plan to conduct a search in the first service and retrieve the data using IDs in the second service.

  1. The records I aim to retrieve are from 500 to 2000. The database size is 100k to 500k (I give a range because it is not finalized)
  2. I have the exact IDs.
  3. Please refer to the above situation.

Thank you very much for your help!
Max