Hey - I have an index of OpenAI embeddings in Chroma - can I somehow import this into Pinecone?
Hi @emilesilvis, sorry for the late reply. There’s no “automatic” way of importing data from Chroma at the moment (although you can submit a feature request). You could create a script which will either:
- Read all embeddings from Chroma, write them to disk, then upsert them all into Pinecone in batches.
- Read the embeddings from Chroma in batches, and write each batch to Pinecone.
Thanks @rschwabco, those are good ideas.
You can migrate all of your collection data with this open-source tool I built from Chroma into Pinecone in a click.
It will automatically re-map the metadata, vectors, namespaces, and ids into Pinecone with no loss.
Note: Make sure your Index dimensions match what you expect to come out of Chroma!
1 Like
Hey, @tim can I know how much time will it take for approximately 10k records to migrate from chroma to pinecone? And which index of pinecone we are choosing for migrating into.
Thanks