We are deeply testing the new reasoning models from OpenAI and I need guidance especially from Pinecone on the future of RAG. I want it to be highly opinionated , data driven and research focused in the following areas :
- When and where is RAG still an effective technique ?
- In the era of Reasoning models, how do you balance the need for static and dynamic search?
- In what data scenarios is RAG effective - Proprietary Data, Public Data , Structured vs Unstructured ?
- RAG Latency - Reranking, changing top K has a cost.
Happy to be an early adopter to prove out certain hypothesis as well