π Why analyze stats look outdated
If only one project is not showing updated analyze stats, its scheduled crawl may not have run. Smart Crawl runs every 7, 14, or 30 days, and the daily crawl job starts it when it is due. A firewall on the site can also block the crawler, so the project never gets fresh data even when a crawl is started.
βοΈ Turn Smart Crawl off and on
This is the first step support uses when a weekly crawl has not been triggered.
- Open the affected project.
- Turn Smart Crawl off.
- Turn Smart Crawl back on.
Turning Smart Crawl back on restarts its schedule and, for a single project, requests a crawl immediately. You can also use Site Audit's Recrawl Site button or OTTO's Manual reprocess button. A crawl that is already running, or a manual recrawl within the last 24 hours, will not start again; the next one stays on schedule. Use the chat widget if those options do not refresh the stats.
π οΈ Whitelist crawler IPs after a firewall block
If the crawl is still blocked, the site firewall is the usual cause. Ask the WordPress admin to check these protections:
- Wordfence
- Sucuri
- The hosting provider firewall
Whitelist every crawler IP listed at https://bots.searchatlas.com/ip_list.txt. Use the full current list, not a single address, because the crawler uses more than one IP.
After the IPs are allowed, turn Smart Crawl off and on once more to request a new crawl. If a crawl is already running or one was manually started within 24 hours, it stays on the existing schedule instead.
π¬ If stats still do not update
If you need further assistance, open the chat widget in the bottom-right corner of the platform and send your message. A member of our support team will reply in the chat.
Tell them which project is stale, that Smart Crawl was toggled, and whether the crawler IPs were whitelisted. Support can help confirm or start a recrawl and keep the case open until updated analyze stats show.