The query embedding, and the embeddings in the index must be generated by the same model (or by a two tower model with matching query and document embedding models ). In this case it sounds like you are using Ada3 to query an index with embeddings generated by Ada2. This will likely not work. Indeed, migrating from one model to another would require regenerating all the vectors.