🧭 Overview
When a site audit appears to complete successfully but the report data does not update, a crawl quota error is often the underlying cause. This article explains how to identify quota exhaustion, reduce quota consumption through crawl speed settings, and decide when manual reprocessing is the right next step.
⚠️ Recognising the Symptoms
You may be dealing with a quota-related refresh failure if you notice any of the following:
- The site audit progress bar reaches 100% but the report metrics do not change.
- A banner or inline message states you are out of quota or have exceeded your crawl limit.
- A re-crawl you triggered recently shows as complete, yet page counts, issues, or scores remain identical to the previous run.
- New pages you added to the site are not appearing in the report.
If you see the out-of-quota message alongside a stale report, the quota error is the blocking issue. Resolving it first is required before any data can refresh.
📊 Check Your Current Quota Usage
Before making any changes, confirm how much quota you have consumed:
- Open Site Metrics (Site Explorer) from the left sidebar.
- Select the project for your site — in this example, destinationinspiration.com.
- Look for the Crawl Quota or Pages Crawled indicator on the project overview. This shows pages used against your plan limit for the current billing period.
- If the used figure is at or near your plan limit, quota exhaustion is confirmed.
Quota is consumed each time the crawler processes a page. A large site, a high crawl frequency, or a fast crawl speed setting can all accelerate consumption.
🐢 Reduce Crawl Speed to Preserve Quota
Lowering the crawl speed is the fastest way to reduce how quickly your remaining quota is spent. This does not cancel an in-progress crawl, but it limits consumption on future crawls within the same billing period.
- In Site Explorer, open the project settings for your site.
- Locate the Crawl Speed or Crawler Settings option.
- Reduce the speed from its current value — for example, move from Fast to Standard or Slow. Each step down meaningfully reduces pages processed per hour.
- Save the settings.
Use a slower crawl speed when you need to audit a large site toward the end of a billing period, when you want to spread quota usage across multiple projects, or when your plan limit is modest relative to your total page count.
🔁 When to Use Manual Reprocessing
Manual reprocessing tells the platform to re-evaluate already-crawled data without consuming additional quota for a fresh crawl. Use it in the following situations:
- You have resolved technical issues on the site and want the report to reflect those fixes without a full recrawl.
- The crawl completed successfully but the report display did not update, and your quota is not exhausted.
- You need updated scores quickly and cannot wait for the next scheduled crawl.
To trigger manual reprocessing:
- Go to Site Explorer and open your site project.
- Look for the Reprocess or Recalculate Report option within the project actions menu.
- Confirm the action. The report will regenerate from the most recent crawl data without initiating a new crawl.
Important: If your quota is exhausted, manual reprocessing will refresh the display but will not pull in any new pages or changes made to the site after the last crawl. A fresh crawl is needed for fully updated data, and that will only be possible once quota resets or your plan is upgraded.
🔄 Quota Reset and Plan Upgrade Options
Crawl quota resets automatically at the start of each billing period. If your current period ends soon, waiting for the reset is often the simplest path.
If you regularly exhaust quota before the period ends, consider the following:
- Reduce crawl frequency — switch from daily to weekly scheduled crawls for stable, mature sites.
- Prioritise projects — pause crawl schedules on lower-priority sites to reserve quota for critical ones.
- Upgrade your plan — if your site portfolio consistently exceeds your limit, a higher-tier plan provides a larger quota allocation.
✅ Step-by-Step Resolution Summary
- Confirm the quota error by checking the Crawl Quota indicator in your Site Explorer project overview.
- If quota is exhausted, lower the crawl speed in project settings to conserve any remaining allocation.
- Use manual reprocessing to refresh the report display from existing crawl data if no new crawl is needed right now.
- Adjust crawl frequency or pause lower-priority projects to prevent recurrence before your quota resets.
- If the data must be fully up to date before your quota resets, consider upgrading your plan.
If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.