Query with metadata only

[tom]

Is there a way to retrieve all vectors and associated metadata from the db which meet filtering requirements without have any vector as part of the query?

[Jasper]

Hi @tom !

Currently as per documentation, either ID or VECTOR is a mandatory value when making a query. So no. It is not currently possible to fetch all data this way. There are some workarounds posted on this forum I think, but there is no official way yet.

Hope this helps

[ziqizhang]

Hi, I have exactly the same use case here… what are the ‘workarounds’? I don’t think making a vector of N dimension of 0 is the same as ‘select *’…

Any tips please? Thanks

[silas]

Just answered a similar question here:

How to fetch ids from a namespace? Sample code in CRUL (not python not node.js but curl) preferred

I don’t think that API exists. The only way to fetch data is to is by providing the list of IDs you want to fetch, at least according to the fetch API docs, which implies that you’re tracking them somewhere outside of Pinecone. [pinecone-fetch] I’d love to see the fetch API expanded to take these optional arguments, consistent with the query endpoint: namespace for limiting to a specific namespace filter for filtering by metadata includeMetadata flag for including metadata in the response i…

Would be great to have an update to the fetch API to allow retrieving data by a filter and/or namespace, as it would help in managing the data vs having to always keep a separate index somewhere else of what data you’ve stored in Pinecone.

[tim]

One method that worked for me was providing an empty n-long query. So for example, if I had a 1536 dimensional namespace I would include my filters and then for vectors has a 1536 long array of all zeros.

Im sure that it isn’t foolproof but for my purposes worked out great!