# Index.upsert resulting in ApiValueError: Unable to prepare type ndarray for serialization

**URL:** <https://community.pinecone.io/t/index-upsert-resulting-in-apivalueerror-unable-to-prepare-type-ndarray-for-serialization/2194>\
**Category:** Support\
**Tags:** vector-database\
**Created:** [June 9, 2023, 8:43am UTC](https://community.pinecone.io/t/index-upsert-resulting-in-apivalueerror-unable-to-prepare-type-ndarray-for-serialization/2194 "2023-06-09T08:43:59Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![fanjum11](https://avatars.discourse-cdn.com/v4/letter/f/b5a626/32.png) [@fanjum11](https://community.pinecone.io/u/fanjum11)\
**Post date:** [June 9, 2023, 8:43am UTC](https://community.pinecone.io/t/index-upsert-resulting-in-apivalueerror-unable-to-prepare-type-ndarray-for-serialization/2194/1 "2023-06-09T08:43:59Z")

</div>

Hi all,  
Need some help. thanks in advance.

I am getting the ApiValueError with the line

index.upsert(vectors=list(zip(ids, embeddings, batch)))

Each of ids, embeddings, batch is of type list; hence this is not really the same problem at given at [Unable to prepare type ndarray for serialization](https://community.pinecone.io/t/unable-to-prepare-type-ndarray-for-serialization/1874)

The error goes away if i comment the above line as follows:

for i in range(0, len(items), batch\_size):  
batch = items[i : min(len(items), i + batch\_size)]

```
ids = [b["id"] for b in batch]
embeddings = [b["embeddings"] for b in batch]
batch = [{"title": b["title"], "url": b["url"], "text": b["text"]} for b in batch]

#index.upsert(vectors=list(zip(ids, embeddings, batch)))

```

The complete error is

* * *

ApiValueError Traceback (most recent call last)  
Cell In[26], line 13  
10 embeddings = [b[“embeddings”] for b in batch]  
11 batch = [{“title”: b[“title”], “url”: b[“url”], “text”: b[“text”]} for b in batch]  
—\> 13 index.upsert(vectors=list(zip(ids, embeddings, batch)))

File /usr/local/lib/python3.9/site-packages/pinecone/core/utils/error\_handling.py:17, in validate\_and\_convert\_errors..inner\_func(\*args, \*\*kwargs)  
15 Config.validate() # raises exceptions in case of invalid config  
16 try:  
—\> 17 return func(\*args, \*\*kwargs)  
18 except MaxRetryError as e:  
19 if isinstance(e.reason, ProtocolError):

File /usr/local/lib/python3.9/site-packages/pinecone/index.py:150, in Index.upsert(self, vectors, namespace, batch\_size, show\_progress, \*\*kwargs)  
145 raise ValueError(‘async\_req is not supported when batch\_size is provided.’  
146 'To upsert in parallel, please follow: ’  
147 ‘[Insert data](https://docs.pinecone.io/docs/insert-data#sending-upserts-in-parallel)’)  
149 if batch\_size is None:  
 → 150 return self.\_upsert\_batch(vectors, namespace, \_check\_type, \*\*kwargs)  
152 if not isinstance(batch\_size, int) or batch\_size \<= 0:  
153 raise ValueError(‘batch\_size must be a positive integer’)

File /usr/local/lib/python3.9/site-packages/pinecone/index.py:237, in Index.\_upsert\_batch(self, vectors, namespace, \_check\_type, \*\*kwargs)  
234 return \_dict\_to\_vector(item)  
235 raise ValueError(f"Invalid vector value passed: cannot interpret type {type(item)}")  
 → 237 return self.\_vector\_api.upsert(  
238 UpsertRequest(  
239 vectors=list(map(\_vector\_transform, vectors)),  
240 \*\*args\_dict,  
241 \_check\_type=\_check\_type,  
242 \*\*{k: v for k, v in kwargs.items() if k not in \_OPENAPI\_ENDPOINT\_PARAMS}  
243 ),  
244 \*\*{k: v for k, v in kwargs.items() if k in \_OPENAPI\_ENDPOINT\_PARAMS}  
245 )

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:776, in Endpoint. **call** (self, \*args, \*\*kwargs)  
765 def **call** (self, \*args, \*\*kwargs):  
766 “”" This method is invoked when endpoints are called  
767 Example:  
768  
(…)  
774  
775 “”"  
 → 776 return self.callable(self, \*args, \*\*kwargs)

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api/vector\_operations\_api.py:956, in VectorOperationsApi. **init**..\_\_upsert(self, upsert\_request, \*\*kwargs)  
953 kwargs[‘\_host\_index’] = kwargs.get(‘\_host\_index’)  
954 kwargs[‘upsert\_request’] =   
955 upsert\_request  
 → 956 return self.call\_with\_http\_info(\*\*kwargs)

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:838, in Endpoint.call\_with\_http\_info(self, \*\*kwargs)  
834 header\_list = self.api\_client.select\_header\_content\_type(  
835 content\_type\_headers\_list)  
836 params[‘header’][‘Content-Type’] = header\_list  
 → 838 return self.api\_client.call\_api(  
839 self.settings[‘endpoint\_path’], self.settings[‘http\_method’],  
840 params[‘path’],  
841 params[‘query’],  
842 params[‘header’],  
843 body=params[‘body’],  
844 post\_params=params[‘form’],  
845 files=params[‘file’],  
846 response\_type=self.settings[‘response\_type’],  
847 auth\_settings=self.settings[‘auth’],  
848 async\_req=kwargs[‘async\_req’],  
849 \_check\_type=kwargs[‘\_check\_return\_type’],  
850 \_return\_http\_data\_only=kwargs[‘\_return\_http\_data\_only’],  
851 \_preload\_content=kwargs[‘\_preload\_content’],  
852 \_request\_timeout=kwargs[‘\_request\_timeout’],  
853 \_host=\_host,  
854 collection\_formats=params[‘collection\_format’])

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:413, in ApiClient.call\_api(self, resource\_path, method, path\_params, query\_params, header\_params, body, post\_params, files, response\_type, auth\_settings, async\_req, \_return\_http\_data\_only, collection\_formats, \_preload\_content, \_request\_timeout, \_host, \_check\_type)  
359 “”“Makes the HTTP request (synchronous) and returns deserialized data.  
360  
361 To make an async\_req request, set the async\_req parameter.  
(…)  
410 then the method will return the response directly.  
411 “””  
412 if not async\_req:  
 → 413 return self.\_\_call\_api(resource\_path, method,  
414 path\_params, query\_params, header\_params,  
415 body, post\_params, files,  
416 response\_type, auth\_settings,  
417 \_return\_http\_data\_only, collection\_formats,  
418 \_preload\_content, \_request\_timeout, \_host,  
419 \_check\_type)  
421 return self.pool.apply\_async(self.\_\_call\_api, (resource\_path,  
422 method, path\_params,  
423 query\_params,  
(…)  
431 \_request\_timeout,  
432 \_host, \_check\_type))

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:185, in ApiClient.\_\_call\_api(self, resource\_path, method, path\_params, query\_params, header\_params, body, post\_params, files, response\_type, auth\_settings, \_return\_http\_data\_only, collection\_formats, \_preload\_content, \_request\_timeout, \_host, \_check\_type)  
183 # body  
184 if body:  
 → 185 body = self.sanitize\_for\_serialization(body)  
187 # auth setting  
188 self.update\_params\_for\_auth(header\_params, query\_params,  
189 auth\_settings, resource\_path, method, body)

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:277, in ApiClient.sanitize\_for\_serialization(cls, obj)  
264 “”“Prepares data for transmission before it is sent with the rest client  
265 If obj is None, return None.  
266 If obj is str, int, long, float, bool, return directly.  
(…)  
274 :return: The serialized form of data.  
275 “””  
276 if isinstance(obj, (ModelNormal, ModelComposed)):  
 → 277 return {  
278 key: cls.sanitize\_for\_serialization(val) for key, val in model\_to\_dict(obj, serialize=True).items()  
279 }  
280 elif isinstance(obj, io.IOBase):  
281 return cls.get\_file\_data\_and\_close\_file(obj)

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:278, in (.0)  
264 “”“Prepares data for transmission before it is sent with the rest client  
265 If obj is None, return None.  
266 If obj is str, int, long, float, bool, return directly.  
(…)  
274 :return: The serialized form of data.  
275 “””  
276 if isinstance(obj, (ModelNormal, ModelComposed)):  
277 return {  
 → 278 key: cls.sanitize\_for\_serialization(val) for key, val in model\_to\_dict(obj, serialize=True).items()  
279 }  
280 elif isinstance(obj, io.IOBase):  
281 return cls.get\_file\_data\_and\_close\_file(obj)

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:289, in ApiClient.sanitize\_for\_serialization(cls, obj)  
287 return cls.sanitize\_for\_serialization(obj.value)  
288 elif isinstance(obj, (list, tuple)):  
 → 289 return [cls.sanitize\_for\_serialization(item) for item in obj]  
290 if isinstance(obj, dict):  
291 return {key: cls.sanitize\_for\_serialization(val) for key, val in obj.items()}

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:289, in (.0)  
287 return cls.sanitize\_for\_serialization(obj.value)  
288 elif isinstance(obj, (list, tuple)):  
 → 289 return [cls.sanitize\_for\_serialization(item) for item in obj]  
290 if isinstance(obj, dict):  
291 return {key: cls.sanitize\_for\_serialization(val) for key, val in obj.items()}

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:291, in ApiClient.sanitize\_for\_serialization(cls, obj)  
289 return [cls.sanitize\_for\_serialization(item) for item in obj]  
290 if isinstance(obj, dict):  
 → 291 return {key: cls.sanitize\_for\_serialization(val) for key, val in obj.items()}  
292 raise ApiValueError(‘Unable to prepare type {} for serialization’.format(obj. **class**. **name** ))

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:291, in (.0)  
289 return [cls.sanitize\_for\_serialization(item) for item in obj]  
290 if isinstance(obj, dict):  
 → 291 return {key: cls.sanitize\_for\_serialization(val) for key, val in obj.items()}  
292 raise ApiValueError(‘Unable to prepare type {} for serialization’.format(obj. **class**. **name** ))

File /usr/local/lib/python3.9/site-packages/pinecone/core/client/api\_client.py:292, in ApiClient.sanitize\_for\_serialization(cls, obj)  
290 if isinstance(obj, dict):  
291 return {key: cls.sanitize\_for\_serialization(val) for key, val in obj.items()}  
 → 292 raise ApiValueError(‘Unable to prepare type {} for serialization’.format(obj. **class**. **name** ))

ApiValueError: Unable to prepare type ndarray for serialization

---

<div class="post-metadata">

**Author:** ![dhruv.anand](https://sea2.discourse-cdn.com/flex020/user_avatar/community.pinecone.io/dhruv.anand/32/1662_2.png) [@dhruv.anand](https://community.pinecone.io/u/dhruv.anand)\
**Post date:** [November 15, 2023, 6:02pm UTC](https://community.pinecone.io/t/index-upsert-resulting-in-apivalueerror-unable-to-prepare-type-ndarray-for-serialization/2194/2 "2023-11-15T18:02:24Z")

</div>

Hi I’m facing the same issue. Were you able to resolve it?
