Delay in Document Vector Ingestion After Successful Ingestion

Support
1

Hey there,

I’m currently facing an issue with my document ingestion process. After successfully ingesting the documents into the system, I’ve noticed a delay in the storage of the document vectors. Despite receiving an “Ingestion complete” message, there’s a noticeable delay of several seconds before the document vectors are fully stored in the system.

I’ve checked the logs and confirmed that there are no errors reported during the ingestion process. However, I’m uncertain about the cause of this delay and would appreciate some guidance on troubleshooting this issue.

Here are some additional details about my setup:

  • I’m using a document loading and splitting mechanism to process PDF documents.
  • The documents are then ingested into a Pinecone database using the PineconeStore.fromDocuments method.
  • The ingestion process completes successfully, but there’s a delay in storing the document vectors.

Could you please provide some suggestions or insights on why this delay might be occurring and how I can address it? Any assistance would be greatly appreciated.

Thanks in advance!

2

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.