---
doc_version: "1.0.0"
last_updated: "2026-07-14T15:00:57.718Z"
title: "How to Keep Content Up to Date"
description: "Re-crawl your sources, interpret crawl reports, retry failed pages, and maintain your ChatbotIQ knowledge base over time."
keywords: [refresh sources, re-crawl, content update, crawl report, maintenance, ChatbotIQ]
---

Your website changes over time, and your bot should reflect those changes. Here's how to keep your knowledge base current.

---

## Refresh a source

1. Go to **Knowledge Base** in the sidebar.
2. Find the source you want to update.
3. Click **Update**.

ChatbotIQ re-crawls all the pages using the same settings as the original crawl. When it finishes, you'll see a crawl report.

---

## Read the crawl report

After a refresh, the report shows:

| Status | Meaning |
|--------|---------|
| **Changed** | Content on this page was updated since the last crawl. The new version is now indexed. |
| **Unchanged** | Content is the same as before. No re-indexing needed. |
| **Failed** | The page couldn't be accessed. See troubleshooting below. |

> **Tip:** Check the "Changed" pages to make sure the new content looks correct. ChatbotIQ has degradation protection, if a page's content shrunk significantly, the update is blocked to prevent data loss.

---

## Retry failed pages

If some pages failed during a crawl:

1. Open the crawl report.
2. Click **Retry Failed** to re-crawl only the failed pages.

Common reasons for failure:
- The page was temporarily unavailable (server error).
- The URL was removed or redirected.
- Rate limiting by the source website (lower concurrency and try again).

---

## When to refresh

- **After updating your website** - if you published new content or updated existing pages, refresh immediately.
- **On a regular schedule** - weekly or bi-weekly is good for most sites.
- **After knowledge gap analysis** - if you added content to fill gaps, refresh to index it.

---

## Delete outdated content

If pages were removed from your website:

1. Go to the source in Knowledge Base.
2. View the indexed pages.
3. Delete individual pages that no longer exist, or delete the entire source if it's no longer relevant.

Your page count decreases automatically.

---

## Related

- [Add a Website Source](/how-to/add-a-website-source/) - source management basics
- [Configure Crawling for Your Site](/how-to/configure-crawling-for-your-site/) - crawling settings
- [Find and Fix Knowledge Gaps](/how-to/find-knowledge-gaps/) - discover what's missing

## Sitemap

Full documentation index: [sitemap.md](/sitemap.md) and [llms.txt](/llms.txt).