Overview
When you run AI recommendation generation across a large set of pages, jobs that include too many pages in a single batch may time out before completing. This article explains the cause and the recommended approach for working through large page sets without losing progress.
Why Large Batches Time Out
AI recommendation generation sends each page through a processing pipeline that analyses content, evaluates on-page signals, and produces actionable suggestions. Each page adds to the total processing time for the job. When a single batch contains too many pages, the cumulative processing time can exceed the system's job timeout threshold, and the job may be cancelled before all pages are completed.
- Pages already processed before a timeout are not lost — their recommendations are saved and visible once the job ends.
- Remaining unprocessed pages will show no recommendations until you rerun generation for them.
Recommended Batch Size
To ensure every job completes successfully, limit each AI generation run to a smaller subset of pages rather than selecting your entire page list at once. Smaller batches process well within the timeout window and give you predictable, reliable results. You can run multiple batches back-to-back — each time selecting only pages that have not yet been processed.
How to Process Large Page Sets in Batches
Follow these general steps to work through a large number of pages without hitting the timeout limit.
- Open the AI generation tool you are using. Navigate to the relevant tool in your Search Atlas account where you run AI recommendation generation.
- Filter for pages without recommendations. Use any available filters to display only pages that have not yet received AI-generated recommendations. This keeps your working list clean and prevents duplicate processing.
- Select a small subset of pages. Choose a manageable batch of pages from your filtered list. Keeping batches small reduces the risk of hitting the timeout threshold.
- Trigger AI generation for your selection. Start the generation job for your selected pages and allow it to run to completion before starting the next batch.
- Wait for the job to finish. Once the batch is complete, the recommendations for those pages will be available.
- Repeat for the next batch. Return to your filtered list, select the next set of unprocessed pages, and repeat the process until all pages have been covered.
What to Have Ready if You Need Support
If you continue to experience timeouts even with smaller batches, please have the following information ready when you contact support:
- The name of the project and the specific tool where the issue is occurring
- The approximate number of pages you were processing when the timeout occurred
- Any error messages or job status indicators you observed
If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.