Skip to content
ChatbotIQ

How RAG Works in ChatbotIQ

RAG (Retrieval-Augmented Generation) is the technology that makes ChatbotIQ different from a generic AI chatbot. Instead of relying on the AI model’s training data (which can be outdated or wrong), RAG first searches your actual content, then uses what it finds to generate an answer.

This is why ChatbotIQ can give accurate, source-cited answers about your content — not generic responses.

The problem RAG solves

Section titled “The problem RAG solves”

AI language models (like GPT-5 or Claude) are trained on vast amounts of internet text. They’re good at language, but they don’t know about your specific product, documentation, or company. If you ask them a question about your help center, they’ll either make something up (hallucinate) or admit they don’t know.

RAG solves this by adding a search step before generation:

  1. Search your content for relevant information.
  2. Generate an answer using what was found.

The AI model never has to guess — it works from your actual content.

How it works at a high level

Section titled “How it works at a high level”

1. Content preparation (happens when you add a source)

Section titled “1. Content preparation (happens when you add a source)”

When you add a source, ChatbotIQ crawls your pages, processes the content, and makes it searchable. This happens automatically in the background.

2. Smart search (happens when a user asks a question)

Section titled “2. Smart search (happens when a user asks a question)”

When someone types a question, ChatbotIQ searches your content using multiple techniques to find the most relevant information — even when the user’s wording doesn’t exactly match your documentation.

3. Answer generation

Section titled “3. Answer generation”

The most relevant content is passed to the AI model along with the user’s question. The model generates an answer based specifically on your content, with instructions to:

  • Only use the provided content (not its training data).
  • Cite which sources it used.
  • Say “I don’t know” if the content doesn’t cover the question.

Why this approach works

Section titled “Why this approach works”

Accuracy

Section titled “Accuracy”

The AI model works from your actual content, not its general training data. This dramatically reduces hallucination.

Source citations

Section titled “Source citations”

Because the system knows exactly which content chunks were used, it can link every answer back to the original pages. Your visitors can click through to verify.

Always current

Section titled “Always current”

When you refresh a source, the knowledge base updates. The AI model doesn’t need to be retrained — it always works from the latest content.

Transparent and debuggable

Section titled “Transparent and debuggable”

The Debug panel in the Playground shows you the entire pipeline: the enhanced query, which chunks were retrieved, their relevance scores, and the final answer. If something is wrong, you can see exactly where the issue is.

Key concepts

Section titled “Key concepts”

Smart search ChatbotIQ doesn’t just match keywords — it understands meaning. If your docs say “reset your credentials” and a user asks “how to change my password,” ChatbotIQ finds it.

Relevance threshold Not all content is relevant enough to use. The RAG Score Threshold setting controls how confident the bot needs to be before using a piece of content. The default works well for most use cases — you can adjust it in bot settings if needed.

Section titled “Related”