Overview
The Site Auditor in Search Atlas gives you control over how much of your website is crawled during each audit. Two key settings shape this behavior: Max Page Limit and Max Crawl Depth. Configuring these correctly helps you focus the audit on the pages that matter most and keep crawl times manageable.
What These Settings Mean
- Max Page Limit: The maximum number of pages the crawler will visit during a single audit. Once this limit is reached, the crawl stops — even if more pages exist on the site.
- Max Crawl Depth: How many links deep the crawler will follow from your start URL. A lower depth value limits the crawl to pages closer to the root; a higher value allows the crawler to follow links further into the site structure.
Setting these values thoughtfully ensures your audit is thorough without consuming unnecessary crawl credits or time.
Setting Max Page Limit and Crawl Depth
Both Max Page Limit and Max Crawl Depth can be configured within the Site Auditor when setting up a new project or updating an existing one. Look for these fields in the crawl configuration area of the Site Auditor project setup or project settings. Enter your desired numeric values for each setting and save your changes before running or re-running the audit so the updated settings take effect.
If you are unsure where to locate these fields in the current version of the platform, or if the options do not appear as expected, please reach out to our support team for guided assistance. When escalating, have the following ready: your project name or URL, the values you are trying to set, and any error message or unexpected behavior you observed.
If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.