Use case

RAG over documents

Embed the library, rerank the passages, then let a chat model answer from those passages only.

What matters

Retrieval quality usually matters more than which chat model writes the last paragraph. Long context is the fallback when you refuse to chunk.

accuracy · long-context · cost

Top picks

  1. #1Cohere: Embed 5 Fast

    An embedding model for the index. Pair it with a reranker and a chat model for the answer.

  2. #2NVIDIA: Nemotron 3.5 Embed 1B (free)

    An embedding model for the index. Pair it with a reranker and a chat model for the answer.

  3. #3LiquidAI: LFM2.5-Embedding-350M (free)

    An embedding model for the index. Pair it with a reranker and a chat model for the answer.

Budget pick

NVIDIA: Nemotron 3.5 Embed 1B (free)

Open-weight pick

LiquidAI: LFM2.5-Embedding-350M (free)

Pitfalls

  • Stuffing a whole wiki into a chat model skips the retriever and still misses the page.
  • Embeddings from one vendor and a reranker from another need a quick relevance check, not a new religion.

Sample prompt

Answer only from the passages below. If they don't contain the answer, say so. Cite the passage ids.