I am using Pinecone via AWS Knowledge Base interface and I want to provide more metadata fields into Pinecone. By default metadata contains these fields:
- metadata: “{"source":"s3://2924-02879803-6A1237204.pdf"}”*
- x-amz-bedrock-kb-data-source-id: “YSVPGW2U0T”
- x-amz-bedrock-kb-document-page-number: 4
- x-amz-bedrock-kb-source-uri: “s3://el8-kb/2924-02879803-6A1237204.pdf”
These are useless in any search and filtering.
On my PDF files in S3 I have many other metadata fields, how do I pass them into Pinecone?
If this is impossible to do via Knowledge base setup process, what are my alternatives with AWS Bedrock and metadata filters?