Model in assistant chat costing

Support
1

I’m trying to understand if the cost associated with this falls under Pinecone or OpenAI. Is the GPT-4o cost part of Pinecone or external?

 const contextResponse = await this.assistant.chat({
        messages: [{ 
          role: 'user', 
          content: query 
        }],
        model: 'gpt-4o',
        topK: 5, // Get top 5 most relevant snippets
        includeHighlights: true,
        contextOptions: {
          returnContext: true
        }
      })

thanks

2

I’m assuming indirectly paying for GPT-4o usage through your Pinecone?

3

Hello and welcome to the Pinecone community @agentgill

The cost associated with using the Assistant includes calling any of the available models. Since you don’t have to provide your API keys, the respective service providers cannot charge you separately for using them.

That said, there is no easy way to calculate the price of the code sample you posted. As you can see in the usage cost table, it will contribute to some parts of the monthly price (like tokens processed), but other factors (storage, usage fee) also contribute to the total amount you get in the invoice at the end of the month.

2 Likes