If you’ve made changes to your website and want Search Atlas to scan it again, you can easily launch a new crawl using the Recrawl option inside Site Auditor.
Running a recrawl helps refresh your audit data so you can review updated insights, monitor site health, and confirm whether recent site changes are being reflected in your audit results. It’s especially useful after technical fixes, content updates, structural changes, or SEO improvements.
🧭 Where to find the Recrawl option
🧭 Where to find the Recrawl option
To recrawl an existing site, follow this path:
Go to the left sidebar and click AI SEO
Under Site Audit, click All Audits
Find your site in the list
Each site appears as a card with key metrics and a View Audit button.
🛠️ How to start a recrawl
🛠️ How to start a recrawl
Once you locate your site:
Click the three vertical dots (⋮) on the site card, near the View Audit button
In the dropdown menu, click Recrawl
That will immediately start a new crawl for the selected site.
🧩 You can also recrawl from the Audit Overview
🧩 You can also recrawl from the Audit Overview
There’s another way to access the recrawl option.
If you click View Audit, the audit Overview page opens. From there, you can also find the Recrawl Site option in the top area of the audit view.
This is helpful if you’re already reviewing your site audit and want to relaunch the crawl without returning to the All Audits page.
📈 What happens after you click Recrawl?
📈 What happens after you click Recrawl?
Once the recrawl begins, Search Atlas starts a new crawl for that site.
You can remain on the page and monitor the crawl as it progresses. The site card will update its crawl status, and during an active crawl, you may also see Live Crawl Logs appear on the card.
This gives you visibility into the crawl process while the new audit data is being collected.
⚙️ Optional but recommended: update crawl settings first
⚙️ Optional but recommended: update crawl settings first
Before launching a recrawl, you may want to adjust your crawl settings to better match your current audit needs.
To do that:
Click the site’s ⋮ menu
Select Crawl Settings
From there, you can configure:
Max. Pages to Crawl
Example: 100 pagesCrawl Frequency
Example: Weekly
Click Show more to reveal advanced settings such as:
User Agent
Ignore robots.txt (toggle)
JS Rendering (toggle)
Crawl Speed (pages per second slider)
URL Exclusion conditions (+ Add condition)
After making your changes:
Click Update
Return to the ⋮ menu
Click Recrawl to launch the new crawl with your updated settings
Use Recrawl whenever you want Search Atlas to refresh the audit for an existing site and reflect the latest version of your website. If you want even better results, review your Crawl Settings first so the next crawl runs with the exact scope and behavior you need.