🧭 Overview
OTTO continuously monitors your website to identify optimization opportunities. However, new pages you add to your site are not detected instantly. Understanding how OTTO's detection cycle works will help you set the right expectations and avoid confusion when newly published pages don't appear right away.
⏱️ How Often Does OTTO Analyze Your Site?
OTTO runs automated analysis cycles on a scheduled basis rather than in real time. This means:
- New pages added to your website are picked up during the next scheduled crawl cycle, not immediately after publishing.
- The detection window can vary depending on your site size, server response times, and current crawl queue priority.
- It is normal for newly published pages to take some time before they appear inside OTTO's page list and receive optimization suggestions.
This is expected behavior and does not indicate a problem with your account or website setup.
🚫 Why Manual Recrawl Is Not Available
A common question from customers is why there is no button to trigger a manual recrawl after adding new pages. OTTO's crawl process is managed automatically by the platform to ensure consistent, system-wide performance for all users. Exposing a manual recrawl option could overload crawl queues and negatively impact analysis quality across the platform. As a result, manual recrawl is not a supported feature at this time.
The best approach is to allow the scheduled cycle to complete. Once OTTO detects your new pages, they will be automatically queued for analysis and optimization suggestions.
📋 What to Do After Adding New Pages
- Publish your new pages and ensure they are live and accessible (not password-protected or blocked by robots.txt).
- Wait for the next OTTO crawl cycle to complete. New pages will appear in your OTTO dashboard once they have been detected and processed.
- Check your OTTO SEO dashboard by navigating to Left sidebar → OTTO SEO → SEO Automation to see if the new pages have been picked up and whether OTTO has generated recommendations for them.
- If your pages include new content clusters or topics, consider reviewing your Topical Maps (Left sidebar → Content → Topical Maps) to align your new pages with your broader content strategy.
✅ Tips to Help OTTO Detect New Pages Faster
- Submit an updated sitemap to Google Search Console. While this does not directly trigger an OTTO crawl, a well-maintained sitemap helps ensure your pages are structured and discoverable.
- Internal linking: Link to your new pages from existing, already-indexed pages on your site. This improves crawlability across all tools, including OTTO.
- Avoid noindex or robots.txt blocks on pages you want OTTO to analyze. Blocked pages will be skipped during crawl cycles.
- Keep page URLs clean and consistent with your existing site structure to prevent detection delays caused by redirect chains.
🔄 After OTTO Detects Your New Pages
Once the crawl cycle is complete and your new pages are detected, OTTO will automatically:
- Add them to your tracked page list inside the OTTO SEO dashboard.
- Generate on-page optimization recommendations and apply eligible automations based on your active OTTO settings.
- Flag any issues that may impact those pages' search performance.
You do not need to take any manual action to trigger this — it happens automatically as part of OTTO's ongoing analysis.
💬 Still Need Help?
If your new pages have not appeared in OTTO after a reasonable amount of time, or if you have added more than 15 pages and are concerned something may not be working as expected, our team is here to help. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.