User specific retrieval


I am curious at which level to handle filtering user-related vector embeddings.

In more detail, I want to enable document retrieval and q-and-a for each user instance. I wondered if I should initialize the documents into a vector database and then filter the vector by the metadata e.g. user_id when I want to retrieve similar documents.

My goal is to incorporate a lot of document embeddings per user and have the best possible performance therefore, would like to know about the best practices on how to store a lot of different documents (which should not be exposed to other users) in pinecone.

Thank you for your feedback.