# General

**URL:** https://community.pinecone.io/c/search-no-filter/7.md

[Latest](https://community.pinecone.io/latest.md) · [Categories](https://community.pinecone.io/categories.md) · [Tags](https://community.pinecone.io/tags.md)

---

## [About the General category](https://community.pinecone.io/t/about-the-general-category/17)

<div class="topic-metadata">

**Author:** [@sophiem](https://community.pinecone.io/u/sophiem)\
**Replies:** 0

</div>

General discussions about search, models, data, use cases, and anything else related. Share your projects, tutorials, ideas, and questions with the community.

---

## [Forum shutting down, please move to Discord](https://community.pinecone.io/t/forum-shutting-down-please-move-to-discord/8512)

<div class="topic-metadata">

**Author:** [@kao](https://community.pinecone.io/u/kao)\
**Replies:** 0\
**Last updated:** [December 30, 2025, 8:32pm UTC](https://community.pinecone.io/t/forum-shutting-down-please-move-to-discord/8512 "2025-12-30T20:32:37Z")

</div>

Hi everyone, we have decided to shut down this forum starting Jan 1, 2026. Going forward we are asking that everyone move to the Pinecone Nearest Neighbors: Official Community Discord for questions and discussions. The e…

---

## [When AI Agents Try to Take Over, And Why They Still Need a Human Touch](https://community.pinecone.io/t/when-ai-agents-try-to-take-over-and-why-they-still-need-a-human-touch/8511)

<div class="topic-metadata">

**Author:** [@leatherjacketstrend](https://community.pinecone.io/u/leatherjacketstrend)\
**Replies:** 0\
**Last updated:** [December 24, 2025, 12:55pm UTC](https://community.pinecone.io/t/when-ai-agents-try-to-take-over-and-why-they-still-need-a-human-touch/8511 "2025-12-24T12:55:20Z")

</div>

Lately, I’ve been experimenting with AI agents for task automation things like scheduling, sending emails, updating databases, or even managing customer requests. It’s wild how much they can do, but also kinda tricky. T…

---

## [Pinecone @ AWS re:Invent 2025](https://community.pinecone.io/t/pinecone-aws-re-invent-2025/8435)

<div class="topic-metadata">

**Author:** [@jocelyn](https://community.pinecone.io/u/jocelyn)\
**Replies:** 0\
**Last updated:** [October 25, 2025, 12:26am UTC](https://community.pinecone.io/t/pinecone-aws-re-invent-2025/8435 "2025-10-25T00:26:53Z")

</div>

Pinecone is the leading vector database for building accurate and performant AI applications at scale in production. Meet us at Booth #534 in the Venetian Expo to see how high-quality, real time retrieval delivers rele…

---

## [Join Pinecone Office Hours, this Friday on Zoom](https://community.pinecone.io/t/join-pinecone-office-hours-this-friday-on-zoom/8431)

<div class="topic-metadata">

**Author:** [@jocelyn](https://community.pinecone.io/u/jocelyn)\
**Replies:** 0\
**Last updated:** [October 21, 2025, 7:23pm UTC](https://community.pinecone.io/t/join-pinecone-office-hours-this-friday-on-zoom/8431 "2025-10-21T19:23:02Z")

</div>

What are you up to this Friday? Don’t miss Pinecone Office Hours on Zoom! Deets below :backhand\_index\_pointing\_down: → Register: Webinar Registration - Zoom Have questions or need help launching your projects? Drop …

---

## [I can't find the information in the knowledge base](https://community.pinecone.io/t/i-cant-find-the-information-in-the-knowledge-base/8404)

<div class="topic-metadata">

**Author:** [@ai.agent](https://community.pinecone.io/u/ai.agent)\
**Replies:** 2\
**Last updated:** [October 13, 2025, 6:09pm UTC](https://community.pinecone.io/t/i-cant-find-the-information-in-the-knowledge-base/8404 "2025-10-13T18:09:57Z")

</div>

Hi, I’m developing a RAG system with Python, Django, and Vapi for a voice client, but when I ask a question, it tells me it can’t find any results. My scores range from 0.2687 to 1.0004. An important point is that the tr…

---

## [Candy AI Clone Project — Memory Issue Driving Me Crazy](https://community.pinecone.io/t/candy-ai-clone-project-memory-issue-driving-me-crazy/8408)

<div class="topic-metadata">

**Author:** [@nitin.tripleminds](https://community.pinecone.io/u/nitin.tripleminds)\
**Replies:** 1\
**Last updated:** [October 6, 2025, 3:13pm UTC](https://community.pinecone.io/t/candy-ai-clone-project-memory-issue-driving-me-crazy/8408 "2025-10-06T15:13:12Z")

</div>

I’m working in Triple Minds and I’m working on a Candy AI Clone project like this. The project is shaping up well, but I’m stuck on a memory issue. Every time the user closes the chat and comes back, the AI forgets the p…

---

## [Handling Full-Document Statistics in RAG Architectures](https://community.pinecone.io/t/handling-full-document-statistics-in-rag-architectures/8393)

<div class="topic-metadata">

**Author:** [@climax040916](https://community.pinecone.io/u/climax040916)\
**Replies:** 2\
**Last updated:** [September 23, 2025, 7:00am UTC](https://community.pinecone.io/t/handling-full-document-statistics-in-rag-architectures/8393 "2025-09-23T07:00:11Z")

</div>

Hi everyone, I have a question about RAG system design. I understand that semantic search is typically used to retrieve the top-k relevant chunks. However, in cases where we need to analyze the entire document to comput…

---

## [Where to save BM25Encoder?](https://community.pinecone.io/t/where-to-save-bm25encoder/8396)

<div class="topic-metadata">

**Author:** [@ftihsrglu](https://community.pinecone.io/u/ftihsrglu)\
**Replies:** 2\
**Last updated:** [September 22, 2025, 2:27pm UTC](https://community.pinecone.io/t/where-to-save-bm25encoder/8396 "2025-09-22T14:27:21Z")

</div>

Hello everyone, I am trying to build a RAG system with hybrid search for my application. In the applciation users will upload their documents and later on they will be able to chat with their documents. I can store the …

---

## [Upsert text in batches using integrated embedding](https://community.pinecone.io/t/upsert-text-in-batches-using-integrated-embedding/8395)

<div class="topic-metadata">

**Author:** [@mb-pinecone-rip](https://community.pinecone.io/u/mb-pinecone-rip)\
**Replies:** 1\
**Last updated:** [September 22, 2025, 1:22pm UTC](https://community.pinecone.io/t/upsert-text-in-batches-using-integrated-embedding/8395 "2025-09-22T13:22:01Z")

</div>

I am trying to batch upsert text chunks and have Pinecone do the embedding with their integrated embedding. My index is pinecone-sparse-english-v0, and I have my text chunked. Below is my chunking code: from PyPDF2 impo…

---

## [Can I configure prompts using Pinecone Assistant?](https://community.pinecone.io/t/can-i-configure-prompts-using-pinecone-assistant/6641)

<div class="topic-metadata">

**Author:** [@dandur](https://community.pinecone.io/u/dandur)\
**Replies:** 3\
**Last updated:** [September 12, 2025, 1:46pm UTC](https://community.pinecone.io/t/can-i-configure-prompts-using-pinecone-assistant/6641 "2025-09-12T13:46:25Z")

</div>

I was able to use pinecone assistant quickly to search content from the documents i have uploaded. How do i allow other users to access the Assistant i have created and am I allowed to use Prompts using Pinecone Assista…

---

## [What's the recommended approach for implementing TTL functionality in Pinecone?](https://community.pinecone.io/t/whats-the-recommended-approach-for-implementing-ttl-functionality-in-pinecone/8385)

<div class="topic-metadata">

**Author:** [@dadepetun](https://community.pinecone.io/u/dadepetun)\
**Replies:** 0\
**Last updated:** [September 12, 2025, 1:01pm UTC](https://community.pinecone.io/t/whats-the-recommended-approach-for-implementing-ttl-functionality-in-pinecone/8385 "2025-09-12T13:01:18Z")

</div>

(topic deleted by author)

---

## [Stream realtime data into pinecone db](https://community.pinecone.io/t/stream-realtime-data-into-pinecone-db/8371)

<div class="topic-metadata">

**Author:** [@ganeshsivakumar85](https://community.pinecone.io/u/ganeshsivakumar85)\
**Replies:** 1\
**Last updated:** [August 27, 2025, 2:42pm UTC](https://community.pinecone.io/t/stream-realtime-data-into-pinecone-db/8371 "2025-08-27T14:42:17Z")

</div>

Hey everyone, I’ve been working on a data pipeline to update AI agents and RAG applications’ knowledge base in real time. Currently, most knowledgeable base enrichment is batch based . That means your Pinecone index lag…

---

## [Using Pinecone for NLP-to-SQL RAG – Is it a good fit?](https://community.pinecone.io/t/using-pinecone-for-nlp-to-sql-rag-is-it-a-good-fit/8367)

<div class="topic-metadata">

**Author:** [@harinathharinath79](https://community.pinecone.io/u/harinathharinath79)\
**Replies:** 0\
**Last updated:** [August 22, 2025, 5:16am UTC](https://community.pinecone.io/t/using-pinecone-for-nlp-to-sql-rag-is-it-a-good-fit/8367 "2025-08-22T05:16:02Z")

</div>

Hi everyone, I’m working on an NLP-to-SQL RAG (Retrieval-Augmented Generation) project and I’m wondering if Pinecone is a good fit for this use case. Could someone explain the pros and cons of using Pinecone for these t…

---

## [Import to index "unable to process your request"](https://community.pinecone.io/t/import-to-index-unable-to-process-your-request/8127)

<div class="topic-metadata">

**Author:** [@automation](https://community.pinecone.io/u/automation)\
**Replies:** 4\
**Last updated:** [August 19, 2025, 1:56pm UTC](https://community.pinecone.io/t/import-to-index-unable-to-process-your-request/8127 "2025-08-19T13:56:34Z")

</div>

I am trying to import data into my AWS us-east-1 serverless index but keep getting the message “We were unable to process your request. If the problem persists, please contact us at https://support.pinecone.io” I am pre…

---

## [Issue with Balancing Sparse and Dense Embeddings in Hybrid Search](https://community.pinecone.io/t/issue-with-balancing-sparse-and-dense-embeddings-in-hybrid-search/5846)

<div class="topic-metadata">

**Author:** [@hansal](https://community.pinecone.io/u/hansal)\
**Replies:** 3\
**Last updated:** [August 9, 2025, 1:01pm UTC](https://community.pinecone.io/t/issue-with-balancing-sparse-and-dense-embeddings-in-hybrid-search/5846 "2025-08-09T13:01:42Z")

</div>

General Overview: We are currently encountering issues while fetching chunks from the Pinecone database using a hybrid-search approach. The following code snippet illustrates the method we are using to scale our hybrid s…

---

## [Tuning Alpha \< 0.5 not giving weightage to keyword at all in Hybrid Search](https://community.pinecone.io/t/tuning-alpha-0-5-not-giving-weightage-to-keyword-at-all-in-hybrid-search/8327)

<div class="topic-metadata">

**Author:** [@vaishnavi.g](https://community.pinecone.io/u/vaishnavi.g)\
**Replies:** 0\
**Last updated:** [August 8, 2025, 9:59pm UTC](https://community.pinecone.io/t/tuning-alpha-0-5-not-giving-weightage-to-keyword-at-all-in-hybrid-search/8327 "2025-08-08T21:59:01Z")

</div>

We are also using hybrid search Retrieval with single hybrid indexing and has used hybrid score normalization method similar as you. These are the issues that we have been facing when we set the alpha \< 0.5: When the…

---

## [Score threshold to filter out irrelevant results](https://community.pinecone.io/t/score-threshold-to-filter-out-irrelevant-results/966)

<div class="topic-metadata">

**Author:** [@mrlowlevel](https://community.pinecone.io/u/mrlowlevel)\
**Replies:** 2\
**Last updated:** [August 6, 2025, 5:46am UTC](https://community.pinecone.io/t/score-threshold-to-filter-out-irrelevant-results/966 "2025-08-06T05:46:47Z")

</div>

Heya, I’ve recently been thinking about how to make sure we only return “sufficiently relevant” results to our users / downstream services. The number of results returned from a query is the minimum of top\_k and the nu…

---

## [What are the biggest challenges you've faced when scaling vector search for real-time applications?](https://community.pinecone.io/t/what-are-the-biggest-challenges-youve-faced-when-scaling-vector-search-for-real-time-applications/8308)

<div class="topic-metadata">

**Author:** [@jocelyn](https://community.pinecone.io/u/jocelyn)\
**Replies:** 1\
**Last updated:** [August 4, 2025, 6:50pm UTC](https://community.pinecone.io/t/what-are-the-biggest-challenges-youve-faced-when-scaling-vector-search-for-real-time-applications/8308 "2025-08-04T18:50:27Z")

</div>

As part of the Pinecone team, I get to hear from a lot of folks working on real-time vector search. A few common themes keep coming up: managing query throughput, handling frequent index updates, and optimizing memory us…

---

## [Search similarity use case which integrated embedding model offered by Pinecone is best for the scenario?](https://community.pinecone.io/t/search-similarity-use-case-which-integrated-embedding-model-offered-by-pinecone-is-best-for-the-scenario/8299)

<div class="topic-metadata">

**Author:** [@s.thirugna](https://community.pinecone.io/u/s.thirugna)\
**Replies:** 2\
**Last updated:** [August 1, 2025, 9:27pm UTC](https://community.pinecone.io/t/search-similarity-use-case-which-integrated-embedding-model-offered-by-pinecone-is-best-for-the-scenario/8299 "2025-08-01T21:27:22Z")

</div>

I’m building an application that relies on high-quality semantic search to retrieve relevant messages and conversations. My goal is to deliver fast, accurate, and contextually aware search results for user queries typed …

---

## [Issue: Incorrect context being fetched in Docker environment despite correct namespace](https://community.pinecone.io/t/issue-incorrect-context-being-fetched-in-docker-environment-despite-correct-namespace/8284)

<div class="topic-metadata">

**Author:** [@tushar.ekad](https://community.pinecone.io/u/tushar.ekad)\
**Replies:** 5\
**Last updated:** [July 29, 2025, 5:17pm UTC](https://community.pinecone.io/t/issue-incorrect-context-being-fetched-in-docker-environment-despite-correct-namespace/8284 "2025-07-29T17:17:51Z")

</div>

Hi everyone, I’m facing a strange issue with my Pinecone integration. The app works perfectly when run locally — it fetches the correct context from the specified namespace. However, when I run the exact same setup insi…

---

## [Are there any examples of representing tables (html or json) format as vectors?](https://community.pinecone.io/t/are-there-any-examples-of-representing-tables-html-or-json-format-as-vectors/8278)

<div class="topic-metadata">

**Author:** [@kavita1](https://community.pinecone.io/u/kavita1)\
**Replies:** 2\
**Last updated:** [July 29, 2025, 3:21am UTC](https://community.pinecone.io/t/are-there-any-examples-of-representing-tables-html-or-json-format-as-vectors/8278 "2025-07-29T03:21:44Z")

</div>

Our evals show that our accuracy for certain questions doesn’t meet the threshold as the data required for these are represented as tables in pdf’s , the semantic meaning is lost as part of the RAG pipeline, are there an…

---

## [Sparse search vs metadata filtering](https://community.pinecone.io/t/sparse-search-vs-metadata-filtering/8265)

<div class="topic-metadata">

**Author:** [@neelashab](https://community.pinecone.io/u/neelashab)\
**Replies:** 1\
**Last updated:** [July 25, 2025, 3:06pm UTC](https://community.pinecone.io/t/sparse-search-vs-metadata-filtering/8265 "2025-07-25T15:06:48Z")

</div>

Hi all! I am a fresh graduate working on an AI project in hopes it will help me find a job. I am working on an LLM powered chatbot that uses RAG to help the user buy group insurance. My intention is to first filter plan…

---

## [Anyone Using Pinecone with a Hybrid Search Setup (Vectors + Filters)?](https://community.pinecone.io/t/anyone-using-pinecone-with-a-hybrid-search-setup-vectors-filters/8259)

<div class="topic-metadata">

**Author:** [@ziddihoon228](https://community.pinecone.io/u/ziddihoon228)\
**Replies:** 2\
**Last updated:** [July 22, 2025, 9:04am UTC](https://community.pinecone.io/t/anyone-using-pinecone-with-a-hybrid-search-setup-vectors-filters/8259 "2025-07-22T09:04:39Z")

</div>

Hey everyone, I’ve been experimenting with Pinecone for a semantic search tool, and I’m curious—has anyone successfully implemented hybrid search, combining both vector similarity and structured filters (like metadata t…

---

## [Multi-tenancy strategies in Pinecone](https://community.pinecone.io/t/multi-tenancy-strategies-in-pinecone/5241)

<div class="topic-metadata">

**Author:** [@bear](https://community.pinecone.io/u/bear)\
**Replies:** 2\
**Last updated:** [July 10, 2025, 3:04pm UTC](https://community.pinecone.io/t/multi-tenancy-strategies-in-pinecone/5241 "2025-07-10T15:04:08Z")

</div>

Today, we published a piece about how to handle multi-tenancy in Pinecone as part of a larger series on tips for getting into production. What questions do you still have? Tips to share? We’d love to hear from you!

---

## [Looking for users to help us improve our console - paid research](https://community.pinecone.io/t/looking-for-users-to-help-us-improve-our-console-paid-research/8215)

<div class="topic-metadata">

**Author:** [@jesirae](https://community.pinecone.io/u/jesirae)\
**Replies:** 0\
**Last updated:** [July 8, 2025, 2:19pm UTC](https://community.pinecone.io/t/looking-for-users-to-help-us-improve-our-console-paid-research/8215 "2025-07-08T14:19:20Z")

</div>

Hi everyone, I’m a product researcher from the Growth Team at Pinecone. Currently I am looking for Pinecone users to conduct 15-30 min 1:1 interviews with to better understand your experience around index creation and ac…

---

## [🚀 Learning is fun — and teaching is even more fun! | Vamshi Enabothala](https://community.pinecone.io/t/learning-is-fun-and-teaching-is-even-more-fun-vamshi-enabothala/8205)

<div class="topic-metadata">

**Author:** [@jocelyn](https://community.pinecone.io/u/jocelyn)\
**Replies:** 0\
**Last updated:** [July 3, 2025, 7:35pm UTC](https://community.pinecone.io/t/learning-is-fun-and-teaching-is-even-more-fun-vamshi-enabothala/8205 "2025-07-03T19:35:03Z")

</div>

---

## [Call for doing a case study of RAG where it is helpful given the era of Reasoning Models](https://community.pinecone.io/t/call-for-doing-a-case-study-of-rag-where-it-is-helpful-given-the-era-of-reasoning-models/7870)

<div class="topic-metadata">

**Author:** [@kavita1](https://community.pinecone.io/u/kavita1)\
**Replies:** 2\
**Last updated:** [June 27, 2025, 6:28pm UTC](https://community.pinecone.io/t/call-for-doing-a-case-study-of-rag-where-it-is-helpful-given-the-era-of-reasoning-models/7870 "2025-06-27T18:28:38Z")

</div>

We are deeply testing the new reasoning models from OpenAI and I need guidance especially from Pinecone on the future of RAG. I want it to be highly opinionated , data driven and research focused in the following areas : …

---

## [Why is Pinecone Assistant so expensive? Any tips to reduce the cost?](https://community.pinecone.io/t/why-is-pinecone-assistant-so-expensive-any-tips-to-reduce-the-cost/8111)

<div class="topic-metadata">

**Author:** [@butiktakicom](https://community.pinecone.io/u/butiktakicom)\
**Replies:** 4\
**Last updated:** [June 19, 2025, 2:25pm UTC](https://community.pinecone.io/t/why-is-pinecone-assistant-so-expensive-any-tips-to-reduce-the-cost/8111 "2025-06-19T14:25:32Z")

</div>

I’ve been building an AI assistant using Pinecone and love the capabilities it offers, especially for RAG-based applications. However, the pricing for Pinecone Assistant is surprisingly high — much higher than I expected…

---

## [OpenAI embeddings not available](https://community.pinecone.io/t/openai-embeddings-not-available/8117)

<div class="topic-metadata">

**Author:** [@felipe.fernandes](https://community.pinecone.io/u/felipe.fernandes)\
**Replies:** 2\
**Last updated:** [June 13, 2025, 7:50pm UTC](https://community.pinecone.io/t/openai-embeddings-not-available/8117 "2025-06-13T19:50:00Z")

</div>

Why are the OpenAI models not available for embedding when I create an index? I only see Microsoft, LLaMA, and Pinecone. Does anyone know why the other options aren’t showing up?

[Next page](https://community.pinecone.io/c/search-no-filter/7.md?page=1)
