How To Handle large amount of datasets

Thanks for providing your code @shubaritha, I’ll take a look.

In the meantime, have you heard of our new Pinecone Assistant product?

It could dramatically simplify building a chatbot that performs RAG for you. You only have to drag and drop your files and we have a complete UI application you can use to expose your chatbot to the world or your company.

Best,
Zack