When I call to ingest vectors (upsert), how do I know when all the vectors got ingested. I am not asking about how many vectors ingested (that I do know from describe stats of the index that contains TotalVectorCount). I am asking how I know that this process completed - because if it did not, I get exception when querying index stats.
if you are upserting via Pinecone clients and you are setting your own ids one way would be to try and fetch that vector after each of the upserts. If you fetch the vector, then its fine, otherwise log it as failed and try again later
Hope this helps