How to Enable Web Search for Your Bot
Web search lets your bot supplement knowledge base results with live web search, scoped to your source domains. If your website has content that changes frequently or wasn’t captured in the last crawl, web search can fill the gap.
Enable web search
Section titled “Enable web search”- Open your bot settings (gear icon in the Playground, or Edit on the Bots page).
- Scroll to the Web Search section (or find it in behavior settings).
- Toggle Web Search Enabled to ON.
- Save.
How it works
Section titled “How it works”When web search is enabled, the bot supplements its knowledge base with live results from your source domains. This helps cover content that hasn’t been indexed yet or has changed since the last crawl.
Important: Web search is scoped to your source domains — it doesn’t search the entire internet. It only looks for content on the same websites you’ve added as sources.
When to use web search
Section titled “When to use web search”- Frequently updated content — if your website changes daily and you can’t re-crawl that often.
- Large sites — when your plan’s page limit doesn’t cover your entire site, web search can find content on pages that weren’t indexed.
- Supplemental coverage — as a safety net to catch content that the crawler might have missed.
When NOT to use web search
Section titled “When NOT to use web search”- Internal/private sites — web search only works for publicly accessible content.
- If your knowledge base is comprehensive — if your crawl covers everything, web search adds latency without benefit.
Related
Section titled “Related”- Bot Settings Reference — web search setting
- How RAG Works — understand how your bot finds answers