Crawl Monitoring in Search Atlas may display No data for several expected reasons — a new or low-traffic domain, a mismatched date range, or a plan that does not include the feature. Use this guide to identify the cause and determine the right next step.
📊 What Crawl Monitoring Tracks
Crawl Monitoring shows how search engines and AI bots interact with your website. It captures:
- Total crawl requests
- Average response time
- Total download size
- Crawler distribution
- Historical crawl activity
- Site indexation percentage
- Crawl purpose (discovery vs. refresh)
- Device / screen size
- Load time distribution
- Crawl frequency
- Crawled pages
🤖 Crawl Analysis by Bot
The Crawl analysis by bot subsection lets you filter crawl data by a specific bot and view dedicated donut charts for:
- Site indexation %
- Crawl purpose
- By device
- Load time distribution
A healthy state shows properly sized donuts, a scrollable bot selector, and aligned legends — all of which render correctly after a recent UI fix.
🔍 Common Reasons Crawl Monitoring Shows No Data
The most common causes fall into two scenarios depending on whether the dashboard has ever shown data before.
Case 1: The dashboard has never shown data
If Crawl Monitoring has never displayed data, one of the following is likely the cause:
- The domain is new or recently launched
- The domain has not had enough crawl activity yet — newer or low-traffic sites may need several weeks to months before meaningful data appears
- The site has limited visibility or low crawler traffic
- The account is not on a plan that includes Crawl Monitoring — confirm your tier (Pro, Agency, or Enterprise) on the Search Atlas pricing page
- Search engines or AI bots have not crawled the site during the selected Daily, Weekly, or Monthly tab range in OTTO SEO → Crawl Monitoring
Case 2: The dashboard previously had data but now shows none
If Crawl Monitoring was working before and has suddenly gone empty, check the following:
- Confirm the selected Daily, Weekly, or Monthly tab in OTTO SEO → Crawl Monitoring covers a period with known crawler activity
- Check whether the domain was recently re-configured, re-verified, or changed in your account
- In Crawl analysis by bot, set the bot selector dropdown to All bots or a bot with known activity
- Confirm the site is still indexable and has not been blocked by an updated
robots.txt - If none of the above explains the drop, this may indicate a data pipeline issue worth escalating to support
✅ What to Check First
Run through this checklist before reporting an issue:
- Confirm the selected tab in OTTO SEO → Crawl Monitoring
- Try switching between Daily, Weekly, and Monthly tabs
- Check whether the domain is new or recently launched
- Confirm the site is indexable and not blocked by
robots.txt - Confirm the account plan includes Crawl Monitoring
- In Crawl analysis by bot, confirm the bot selector is set to All bots or a bot with known activity — not a specific low-traffic bot
- Allow more time for crawler activity to accumulate if the site is new or low-traffic
After completing these steps, you will know whether the empty dashboard is expected or signals a real issue that needs investigation.
💡 Crawl Monitoring and Domain Age
Crawl Monitoring becomes more useful as your domain builds crawl history. For newer domains, some charts may remain empty until search engines and AI bots begin crawling the site more frequently.
❓ Frequently Asked Questions
Does 'No data' mean Crawl Monitoring is broken?
Not necessarily. No data is expected for new domains or sites that have not yet accumulated enough crawler activity.
How old does a domain need to be before Crawl Monitoring shows data?
There is no fixed threshold. Newer or low-traffic domains may need several weeks to months of active crawl activity before meaningful data appears.
Is Crawl Monitoring available on every plan?
No. Crawl Monitoring is available on Pro, Agency, and Enterprise plans. Check the Search Atlas pricing page to confirm whether your plan includes this feature.
🎯 You now know how to diagnose a "No data" state in Crawl Monitoring and what to do next. If the dashboard remains empty after waiting several weeks and ruling out every cause above, contact the Search Atlas support team so we can investigate further.