Indexing
By Camilo Aponte
By Camilo Aponte
🚀 Crawl a Vercel Staging Site Without Google Indexing
🔍 Understand HTTP Codes and Indexing
🧭 Overview HTTP status codes and indexing directives tell search engines how to handle URLs. They are related, but they do not mean the same thing. A correct fix depends on the intended state of each URL. ✅ What a 200 status means A 200 response means the server successfully returned content. It does not guarantee that Google will index the URL. Google can pass the content to its indexing systems, but indexing is not guaranteed. Use 200 for active, useful pages. If duplicate or low-value copies should not appear in search, add a noindex directive or consolidate the pages with the appropriate canonical setup. 🚫 How noindex works noindex tells search engines not to include a URL in search results. It can be delivered in a meta robots tag or an HTTP X-Robots-Tag response header. Use noindex for active routes that must remain available, such as dashboards, previews, registration pages, staging interfaces, or other functional URLs. For example, a live signup path such as dashboard.searchatlas.com/register should use noindex, not 410. Make sure search engines can crawl the URL to see the noindex directive. Blocking the URL in robots.txt can prevent Google from reading the directive. 🗑️ 404 versus 410 Both 404 Not Found and 410 Gone are 4xx responses. Google treats all 4xx responses, except 429, similarly: previously indexed URLs are removed over time, newly discovered URLs are generally not processed, and crawling gradually decreases. There is no reliable Google behavior where 404 URLs are retried for months while 410 URLs are immediately removed. Choose the status based on the URL's intended state: - 404: Use when a page is unavailable and no permanent retirement signal is required. - 410: Use as a clear convention for intentionally retired routes that will not return. - noindex: Use when the route is active and must remain accessible. A status-code change alone may not stop discovery. Remove retired URLs from XML sitemaps and internal links, and update other references that continue to expose them. 🔎 Why noindex rows can persist SEO reports may continue showing URLs as excluded by noindex after the fix is live. These rows are usually crawl-time observations, not proof that the directive failed. Google validation can take about two weeks or longer. Compare the last crawl date with the fix date, inspect the current response headers, and use URL Inspection when available. Treat the issue as a regression only if the live response was incorrect when Google recrawled the URL. Do not restart validation solely because an older report row remains. 🛠️ Recommended verification steps 1. Confirm the intended state for each URL before selecting 404, 410, 200, or noindex. 2. Check the live HTTP status and confirm the expected X-Robots-Tag or meta robots directive. 3. Verify that robots.txt does not block Google from accessing a URL that needs to be evaluated for noindex. 4. Remove retired URLs from sitemaps and internal links. 5. Record the fix date and compare it with the URL's last crawl date before escalating. 6. Recheck each host live; do not rely only on older crawl data or report rows. 📊 Where to review Search Atlas data In Search Atlas, open OTTO SEO from the left sidebar. Use Crawl Monitoring for crawl observations, All Audits for detected issues, and Knowledge Base for related guidance. Review the live response before creating or reopening a task. 💬 Need help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔍 GSC Instant Indexing Limits and Dynamic Indexing
🚧 Why Can't I Add a Service Account for GSC Instant Indexing? Google periodically pauses new access to its Instant Indexing API when overall quota demand across all users reaches its limit. This is a restriction enforced on Google's side — it is not caused by your Search Atlas account or any configuration error you have made. When this happens, you will not be able to complete the Service Account setup for GSC Instant Indexing. The connection process will stall or fail during the authorization step. Current status: Google has paused the issuance of new Instant Indexing API access. Existing Service Accounts that were connected before the pause continue to work normally. New accounts cannot be added until Google reopens access. ⚠️ Why Isn't There a Warning in the UI? We understand this is frustrating. When quota is exhausted, customers currently receive no in-product message explaining why the Service Account setup fails — which forces an unnecessary trip to support. Our product team has logged this as a known UX gap and a UI warning is planned for a future release. Once shipped, the platform will display a clear notice when Google's Instant Indexing API quota is unavailable, so you will know immediately without needing to contact support. We appreciate your patience while this improvement is in progress. 💡 What Is Dynamic Indexing and How Does It Help? Dynamic Indexing is Search Atlas's built-in alternative to the Google Instant Indexing API. It submits your URLs for indexing through multiple channels simultaneously, reducing your dependency on any single API quota or service account. Key things to know about Dynamic Indexing: - No Service Account required. It works independently of the GSC Instant Indexing API, so the current Google quota pause does not affect it. - Multi-channel submission. Dynamic Indexing sends your URLs through several pathways at once, increasing the chance that Googlebot crawls and indexes your pages faster. - Built into Search Atlas. You do not need to configure any third-party credentials or external tools to use it. - Recommended workaround. While Google's Instant Indexing API access remains paused for new accounts, Dynamic Indexing is the recommended method to get your pages indexed promptly. ✅ Is It Safe to Deploy All 59 Links at Once? Yes, it is safe to submit all your links through Dynamic Indexing in a single batch. There is no risk of penalizing your site or triggering a spam flag by submitting multiple URLs at the same time. A few things to keep in mind before you deploy: 1. Confirm the URLs are live. Make sure every link resolves correctly and returns a 200 status code. Submitting broken or redirected URLs wastes your submission quota and slows down indexing. 2. Check for noindex tags. If a page carries a noindex directive, Google will crawl it but will not index it regardless of how it was submitted. 3. Prioritize high-value pages first. While bulk submission is supported, consider ordering your list so your most important pages appear at the top. Most indexing pipelines process submissions sequentially. 4. Allow up to 72 hours. Indexing is ultimately controlled by Google. Dynamic Indexing accelerates the process, but it does not guarantee an instant result for every URL. Once you have verified the above, go ahead and submit your full batch. There is no need to split the 59 links across multiple sessions. 🔄 How to Switch to Dynamic Indexing 1. Log in to Search Atlas and open the Authority section from the left navigation menu. 2. Select Indexer (URL Indexer). 3. Paste or upload your list of URLs. 4. Click Index URLs to deploy all links. 5. Monitor submission status in the results panel. Each URL will show its current state as Search Atlas processes the batch. 📋 Quick Reference: Instant Indexing vs. Dynamic Indexing - GSC Instant Indexing API: Requires a Google Service Account — currently unavailable for new connections due to Google quota pause. - Dynamic Indexing: No Service Account needed — available now, supports bulk submission, recommended alternative. 🙋 Need More Help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔗 URL Indexer Input Field Improvements
The URL Indexer input field in the Authority section has been updated to include an https:// protocol placeholder and automatic validation, making it easier to submit URLs correctly without manual formatting. ✨ What's New Previously, the URL input field in the URL Indexer lacked a visible protocol placeholder, which could lead to submission errors or incorrectly formatted URLs. The field now displays an https:// placeholder by default and includes protocol validation and autocomplete, ensuring that submitted URLs are properly formatted before indexing begins. 🛠️ How to Use It 1. Navigate to the Authority section in your Search Atlas left sidebar. 2. Open the Indexer tool. 3. Click on the URL input field — you will see the https:// placeholder guiding your entry. 4. Begin typing your URL. If the protocol is missing, it will be automatically completed for you. 5. Submit your URL for indexing as usual. 📋 What to Expect The input field will now enforce proper URL formatting by prompting users with an https:// placeholder and validating the protocol before submission. URLs that do not include a valid protocol will be automatically corrected or flagged, reducing indexing errors caused by malformed entries. This change applies to all URL Indexer submissions going forward. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔌 Connect GCP Before Submitting URLs for Indexation
🧭 Overview If you see zero URLs processing in the URL Indexer — even after submitting URLs and waiting past the 96-hour window — the most common cause is a missing Google Cloud Project (GCP) connection. The URL Indexer requires an active GCP project with the Indexing API enabled and a valid service account key before any URLs can be submitted for indexation. Without this setup, submissions will not process regardless of how much time has passed. 🔍 How to Check Your Current Setup Before troubleshooting submission status or crawl delays, confirm that your GCP project is properly connected: 1. In the left sidebar, click Authority, then select Indexer (URL Indexer). 2. Look for a GCP connection indicator or a prompt to connect a Google Cloud Project. 3. If no GCP project is shown as connected, follow the steps below to set one up. ⚙️ Step 1 — Create or Select a Google Cloud Project 1. Go to the Google Cloud Console and sign in with your Google account. 2. Click the project selector at the top of the page and choose an existing project, or click New Project to create one. 3. Give your project a recognisable name (for example, SearchAtlas Indexing) and click Create. ⚙️ Step 2 — Enable the Indexing API 1. Inside your GCP project, open the left menu and go to APIs & Services → Library. 2. Search for Web Search Indexing API. 3. Click on the result and then click Enable. 4. Wait for the API to finish enabling before proceeding. ⚙️ Step 3 — Create a Service Account and Download the Key 1. Go to APIs & Services → Credentials. 2. Click Create Credentials and select Service Account. 3. Enter a name for the service account and click Create and Continue. 4. Skip the optional role and user access steps by clicking Done. 5. On the Credentials page, click your new service account, then open the Keys tab. 6. Click Add Key → Create new key, choose JSON, and click Create. The key file will download automatically — keep it safe. ⚙️ Step 4 — Grant the Service Account Access to Google Search Console 1. Open Google Search Console. 2. Select the property that matches the URLs you want to index. 3. Go to Settings → Users and permissions → Add user. 4. Enter the service account's email address (visible on the Credentials page in GCP) and set the permission to Owner. 5. Click Add. 🔗 Step 5 — Connect the GCP Project in Search Atlas 1. In the left sidebar, click Authority, then select Indexer (URL Indexer). 2. Follow the on-screen prompt to connect a Google Cloud Project. 3. Upload the JSON key file you downloaded in Step 3. 4. Once connected, you should see your GCP project listed as active. ✅ Step 6 — Resubmit Your URLs 1. Still in Authority → Indexer (URL Indexer), add the URLs you want to submit. 2. Click Index URLs and confirm the submission. 3. Processing status will update as Google's Indexing API receives and handles the requests. Allow up to 96 hours for status changes to reflect in the dashboard. ⚠️ Why Zero URLs Were Processing Before URLs submitted before a GCP project is connected are not queued — they are not held for later processing. If you submitted URLs on June 5 and no GCP project was connected at the time, those submissions did not go through. You will need to resubmit them after completing the setup steps above. ❓ Frequently Asked Questions - Can I use any GCP account? Yes, any Google account with access to Google Cloud Console can create a project. A free GCP account is sufficient. - Do I need a separate GCP project for each website? No. One GCP project with the Indexing API enabled can cover multiple websites, provided each site is added to Google Search Console and the service account is granted Owner access for each property. - What if the API is enabled but submissions still show zero? Double-check that the service account email has Owner-level access in Search Console, and that the correct JSON key file was uploaded in Search Atlas. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
⚡ Understanding Instant Indexing and Google Timelines
🔍 What Is Instant Indexing? Instant Indexing is a feature available on the Property plan that submits your URLs directly to Google's Indexing API. This signals Google to crawl and index those pages faster than standard organic discovery. However, the term "instant" refers to the speed of the submission request, not a guarantee that Google will index the page immediately after. ⏱️ Why Pages Can Still Take Time to Index Even after a successful Instant Indexing submission, Google retains full control over when and whether a page is actually indexed. Several factors influence this timeline: - Google's crawl queue: Google prioritises pages based on its own internal signals, including your site's crawl budget, domain authority, and historical crawl patterns. - Page quality signals: Pages that are thin, duplicated, or have technical issues may be deprioritised or skipped entirely. - Site authority: Newer or lower-authority domains typically experience longer indexing delays than established sites. - Server response times: If your server is slow or intermittently unavailable, Google may defer crawling. - Content freshness signals: Pages that are not frequently updated may receive fewer crawl visits overall. 📅 What Is a Realistic Indexing Timeline? While Instant Indexing can dramatically reduce the time Google takes to notice a page, it is not a bypass of Google's systems. Here is what most customers experience: - Best case: Some pages are crawled and indexed within a few hours of submission. - Typical case: Most pages are indexed within 24–72 hours of a successful submission. - Longer delays: Pages on newer sites, or those flagged for quality review by Google, may take one to two weeks or longer. Seeing pages listed as waiting to index after two days is within the normal range and does not indicate a problem with your plan or the submission itself. ✅ How to Check Your Submission Status You can verify that your URLs were submitted successfully within Search Atlas. A successful submission means the request reached Google — it does not confirm the page has been indexed yet. To verify actual indexing status, use Google Search Console or run a site: search in Google (e.g., site:yourdomain.com/your-page) to check whether the URL appears in Google's index. 🛠️ Steps to Improve Your Indexing Rate If pages are consistently slow to index, consider the following actions: 1. Ensure your pages meet Google's quality guidelines — avoid thin, duplicate, or low-value content. 2. Improve your site's crawlability — check for crawl errors in Google Search Console and resolve any blocking issues. 3. Build site authority — earning backlinks and publishing consistent, high-quality content helps Google prioritise your domain over time. 4. Check server performance — ensure your hosting environment responds reliably and quickly to Googlebot requests. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔍 URL Indexer Plan Eligibility and Quota Explained
🗺️ Overview The URL Indexer tool inside Search Atlas helps you submit URLs directly to search engines for faster indexing. However, access to this tool and the ability to add Indexer Quota depends on your current subscription plan. This article explains plan eligibility, how quota works, and what to do if you encounter errors. 📋 What Is Indexer Quota? Indexer Quota is the number of URLs you can submit for indexing within a given billing period. Each submission consumes one unit of quota. Once your quota is used up, you will need additional quota to continue submitting URLs. ✅ Plan Eligibility for URL Indexer URL Indexer is not available on all Search Atlas plans. Before attempting to add or use Indexer Quota, confirm that your plan includes this feature. - Eligible plans: URL Indexer access is included on select mid-tier and higher plans. Check your plan's feature list in your account settings to confirm. - Ineligible plans: Entry-level or starter plans may not include URL Indexer. If your plan does not include it, you will not be able to add quota or use the tool. To check your current plan and included features, navigate to your account billing or subscription settings. 🛠️ How to Access URL Indexer 1. In the left sidebar, click Authority. 2. From the expanded menu, select Indexer (URL Indexer). 3. If the tool loads successfully, your plan includes access. If you see an access restriction message, your plan may not be eligible. ⚠️ Why Am I Getting an HTTP 500 Error? An HTTP 500 error when trying to add Indexer Quota is most commonly caused by one of the following reasons: - Plan ineligibility: Your current subscription plan does not include URL Indexer, so the system cannot process the quota addition request. - Quota not sold separately: Indexer Quota is tied to eligible plans and is not available as a standalone add-on purchase for all plan types. Attempting to add quota on an ineligible plan will trigger a server error. - Temporary system issue: In rare cases, a 500 error may indicate a temporary platform error unrelated to your plan. Refreshing the page and trying again after a few minutes can help rule this out. 💡 Can I Purchase Indexer Quota Separately? Whether Indexer Quota can be purchased as a standalone add-on depends on your current plan: - If you are on an eligible plan, additional quota may be available to purchase through your account or billing settings. - If you are on an ineligible plan, you will need to upgrade your subscription to a plan that includes URL Indexer before quota can be added. Upgrading your plan is the recommended path if you want to unlock URL Indexer access and begin purchasing or using Indexer Quota. 🚀 How to Add Indexer Quota (Eligible Plans) 1. Navigate to Authority → Indexer (URL Indexer) in the left sidebar. 2. Look for the option to add or top up your Indexer Quota. 3. Select the quantity you wish to add and confirm the purchase. 4. Your quota balance will update immediately after a successful transaction. If you complete these steps and still encounter an HTTP 500 error, the issue may be related to your plan type or a temporary system error. 🔄 Troubleshooting Steps 1. Confirm your plan includes URL Indexer by reviewing your subscription details. 2. Clear your browser cache and reload the platform. 3. Try adding quota in a different browser or incognito window. 4. If the error persists after confirming plan eligibility, escalate to our support team. 💬 Need More Help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔗 How It Works: URL Indexer
🔗 What It Is The URL Indexer submits your URLs to Google to encourage faster indexation. Instead of waiting for Google to discover and index new pages, backlinks, or refreshed content on its own, you can submit them directly through the Search Atlas URL Indexer to help them get crawled and indexed sooner. It's designed for pages that need to appear in search results quickly — newly published articles, backlinks from cloud stacks or press releases, fresh product pages, or other URLs Google hasn't yet picked up. ⚙️ What It Does - 🚀 Submits batches of URLs to Google to support accelerated indexation - 📊 Tracks the indexation status of every submitted URL - 📋 Generates a detailed indexation report (indexed vs. not-indexed) - 🔗 Works with the URLs you submit, including your own pages and the backlinks pointing to them 🧩 What You Need - 📝 A list of URLs (manual entry or CSV upload) - 🌐 Each URL must start with http:// or https:// - 💳 Universal Credits — to cover the submission cost (priced per URL) 🚀 How to Index URLs 1️⃣ Option 1: Manual Submission - 🔗 Open Authority → Indexer (URL Indexer) in your dashboard - ➕ Click Index URLs and give it a name (e.g., "October Backlinks" or "New Blog Posts") - 📝 Paste your URLs into the input field — one per line - 💳 Confirm the cost and submit - 📊 The batch enters the Pending → Submitted → Indexing pipeline ✅ Best for: small lists, ad-hoc submissions, single-page indexing. 2️⃣ Option 2: CSV Upload - 📄 Prepare a CSV file with one URL per row (no headers needed, just the URLs) - 🔗 Open Authority → Indexer (URL Indexer) and click Index URLs - 🏷️ Name your batch - ⬆️ Upload the CSV file - 🔍 The system parses every URL, validates the format, and shows you the count and cost before submission - 💳 Confirm and submit ✅ Best for: large lists, bulk backlink indexing, recurring indexing workflows, agency-scale operations. ⚠️ Check your dashboard for any per-batch size limits before submitting large lists. 📊 The Indexing Pipeline 📥 Submission URLs are validated and queued for processing. ⚙️ Processing The indexer submits each URL to Google's indexation pipeline. 📊 Status moves through: Pending → Submitted → Indexing → Indexed / Not Indexed 👀 Tracking You can check batch progress at any time and see URL-level status — which URLs are indexed, still pending, or failed. 📋 Reporting A complete CSV report is generated after the indexation cycle, showing the final status of every URL. 📈 What You Get - 🚀 Faster indexation — pages can be picked up by Google sooner than waiting for organic discovery - 👀 URL-level visibility — see exactly which URLs got indexed - 📄 Downloadable reports — full CSV of every batch result - ⚡ No manual Google Search Console work — bulk submission without inspecting URLs one-by-one - 🔗 Higher backlink ROI — links can't pass authority until they're indexed ✅ Best Practices - 🚀 Submit URLs as soon as they go live — don't let new pages sit unindexed - 🏷️ Group similar URLs into named batches (e.g., by campaign, content type, or month) for easy tracking - 🔄 Re-index after major content updates - 🔗 For backlinks, submit both the backlink URL and the linked page for full impact - 📄 Use CSV upload for large lists — faster, cleaner, and less error-prone than manual paste - 👀 Check status before submitting again — duplicate submissions waste credits
⚡ Instant Indexing Requires a Pro or Agency Plan
🔍 What This Error Means If you attempt to activate Instant Indexing on a project and receive an HTTP 400 'Unable to activate indexing' response with is_transient: false, your current subscription does not include access to this feature. This is a plan-level restriction, not a configuration problem. Importantly, this error will appear even when every other prerequisite is correctly in place — including the tracking pixel installed on your site, Google Search Console (GSC) connected, and your sitemap registered. A non-transient 400 error means no amount of reconfiguration will resolve it; a plan upgrade is required. ✅ Which Plans Include Instant Indexing Instant Indexing is available exclusively on the following Search Atlas subscription plans: - Pro - Agency Starter plans and free trials do not include access to Instant Indexing. If your account is on a lower-tier plan, every activation attempt will return a non-transient 400 error, regardless of your project's setup. 🔧 How to Upgrade Your Plan 1. Log in to Search Atlas and click your account avatar in the top-right corner of the platform. 2. Select Billing from the dropdown menu. 3. Go to the Plans & Top-ups tab (Billing). 4. Select the Pro or Agency plan and complete the checkout steps. 5. Once your upgrade is confirmed, navigate to Left sidebar → OTTO SEO → All Sites → [your project card] → Instant Indexing and activate the feature for your project. 📋 Already on Pro or Agency? Check These First If you are already on a qualifying plan and still see the HTTP 400 error, confirm the following before contacting support: - Pixel installed: Verify the Search Atlas tracking pixel is present in the of your site and loading without errors. - GSC connected: Go to Avatar → Settings → Integrations and confirm Google Search Console shows a green connected status. - Sitemap registered: Ensure your sitemap is submitted and verified directly inside your Google Search Console account, not only within Search Atlas. - Correct project selected: Confirm you are activating Instant Indexing on the intended project under Left sidebar → OTTO SEO → All Sites. ❓ Frequently Asked Questions Does a plan upgrade take effect immediately? Yes. Upgrades are applied instantly. You can activate Instant Indexing as soon as your payment is confirmed — no waiting period. Will I lose my project data when I upgrade? No. All existing projects, configurations, connected integrations, and historical data are fully preserved when you change plans. Can I activate Instant Indexing for multiple projects? Yes. Once on a Pro or Agency plan, you can activate Instant Indexing across all projects in your account from Left sidebar → OTTO SEO → All Sites. What does is_transient: false mean in the API response? A is_transient: false flag means the error is permanent under the current account conditions — it will not resolve by retrying or waiting. The root cause must be addressed first, which in this case means upgrading to a Pro or Agency plan. If you need further assistance, open the chat widget in the bottom-right corner of the platform any type human teammate to be connected with a member of our team.
🔍 Why Your Submitted URLs Aren't Getting Indexed
🗺️ Overview The URL Indexer tool in Search Atlas helps you request faster crawling and indexing of your URLs by search engines. However, submitting a URL does not guarantee it will be indexed — and in some cases, the process can take longer than expected. This article explains why that happens and what steps you can take. ⚙️ How the URL Indexer Works When you submit URLs through Left sidebar → Authority → Indexer (URL Indexer), Search Atlas sends indexing requests to search engines on your behalf using protocols like IndexNow. Here is what happens after submission: 1. Your URLs are queued and submitted to supported search engines. 2. Search engines receive the ping and add the URLs to their crawl schedule. 3. The search engine crawler visits and evaluates the page. 4. If the page meets quality criteria, it is added to the index. Steps 3 and 4 are entirely controlled by the search engine — Search Atlas cannot force or speed up those stages. ⏱️ Why Indexing Can Take Longer Than Expected Even after a successful submission, URLs may not appear in search engine indexes for days or even weeks. Common reasons include: - Search engine crawl queue: Search engines prioritise URLs based on their own signals. New or low-authority domains are often crawled less frequently. - Page quality signals: If a page has thin content, duplicate content, or poor technical SEO, search engines may crawl it but choose not to index it. - Crawlability issues: A noindex tag, robots.txt block, or server error (such as a 404 or 500) will prevent indexing regardless of submission. - Domain authority: Newer domains with few backlinks tend to be indexed more slowly than established sites. - Search engine processing time: Even under normal conditions, it can take 1–4 weeks for some URLs to be indexed after a successful submission request. ✅ Steps to Troubleshoot Unindexed URLs Follow these steps before concluding there is a platform issue: 1. Check the URL format: Make sure every URL starts with https:// (e.g., https://yourdomain.com/page). URLs submitted without the correct protocol may not be processed correctly. 2. Verify the page is crawlable: Use Google Search Console or a site audit tool to confirm the URL returns a 200 status code, has no noindex directive, and is not blocked by robots.txt. 3. Confirm content quality: Ensure the page has unique, substantive content. Thin or duplicate pages are frequently crawled but not indexed. 4. Check your submission status: Go to Left sidebar → Authority → Indexer (URL Indexer) and review whether your URLs show a confirmed submitted status. If URLs are missing from the list but your quota was deducted, see the note below. 5. Allow sufficient time: If fewer than 14 days have passed since submission, continue to wait. Indexing timelines vary significantly by search engine and domain. 6. Resubmit if needed: If more than 14 days have passed, the page is technically sound, and the URL still does not appear in search results, try resubmitting it through the URL Indexer. ⚠️ Known Issues and Current Status Our team has investigated and resolved several technical issues related to the URL Indexer, including: - URLs submitted via file upload or manual entry not always appearing in the final submission list. - Quota being deducted even when submissions did not process correctly. - A silent network error that, in some cases, prevented URLs from being submitted to search engines on the production environment. These issues have been resolved. If you submitted URLs during a period when you experienced any of the above problems, we recommend resubmitting those URLs to ensure they are properly processed. If you believe your quota was incorrectly deducted, please reach out via the live chat widget so our team can review your account. 💡 Tips for Faster Indexing While no method guarantees instant indexing, these best practices can improve your results: - Submit URLs for pages that are linked from other indexed pages on your site — internal links help crawlers discover and prioritise new content. - Build at least one external backlink to the page before or shortly after submitting. - Submit your sitemap to Google Search Console and Bing Webmaster Tools in addition to using the URL Indexer. - Ensure your site loads quickly and is mobile-friendly, as these are positive crawl priority signals. 💬 Still Need Help? If you have followed the steps above and your URLs are still not indexing after 14+ days, or if you suspect a platform issue such as incorrect quota deductions, we are here to help. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🗂️ OTTO Instant Indexing vs. URL Indexer Explained
🔍 Overview Search Atlas offers two separate indexing features: OTTO Instant Indexing and the Authority URL Indexer. These tools work differently and have different setup requirements. This article clarifies exactly what each feature does, what credentials it needs, and where to configure everything — so you never spend time on setup steps that do not apply to your chosen tool. ⚡ What Is OTTO Instant Indexing? OTTO Instant Indexing is the indexing capability built directly into OTTO, Search Atlas's OTTO SEO automation engine. It submits your URLs for indexing using one of two methods: - IndexNow — a protocol supported by Bing, Yandex, and other search engines. Setup requires only a plain-text verification file placed on your site. No Google Cloud Project (GCP) is needed. - Google Search Console (GSC) connection — links your GSC property to OTTO so pages can be submitted through Google's Indexing API via your existing GSC account. No JSON key upload is required inside OTTO. Important: OTTO Instant Indexing does not require you to create a Google Cloud Project, generate a service account, or upload a JSON key anywhere in OTTO. If you have been directed toward those steps for OTTO, that guidance was incorrect. 🌐 What Is the Authority URL Indexer? The URL Indexer is a separate tool in Search Atlas, accessed via the left sidebar → Authority → URL Indexer (URL Indexer). It is designed for bulk URL submission directly through Google's Indexing API using your own Google Cloud credentials. This tool does require a Google Cloud Project setup, including: 1. Creating a GCP project and enabling the Google Indexing API. 2. Generating a service account with the correct permissions. 3. Downloading the JSON key file from GCP. 4. Uploading that JSON key into the Authority URL Indexer tool inside Search Atlas. The JSON key upload field exists only inside the Authority URL Indexer — not inside OTTO. 📋 Side-by-Side Comparison - OTTO Instant Indexing — IndexNow: No GCP required. Add a plain-text file to your site to verify ownership, then activate in OTTO. - OTTO Instant Indexing — GSC connection: No GCP or JSON key required. Connect your Google Search Console account through the standard OAuth flow in OTTO settings. - Authority URL Indexer: GCP required. Create a service account, download a JSON key, and upload it inside the Authority URL Indexer tool. 🛠️ How to Enable OTTO Instant Indexing Follow these steps to activate indexing through OTTO using IndexNow or your GSC connection. 1. Go to OTTO SEO → All Sites (SEO Automation) in the left sidebar (URL: /seo-automation-v3). 2. Select or open the OTTO session for the site you want to configure. 3. Navigate to the Indexing section within your OTTO dashboard. 4. Choose your preferred method: IndexNow or Google Search Console. - For IndexNow: Download the provided verification text file and upload it to the root directory of your website. Once the file is live, return to OTTO and confirm verification. - For GSC: Go to Site Metrics (GSC page) and click Connect GSC Account, then complete the OAuth authorisation flow using the Google account that has access to your GSC property. 5. Once connected, OTTO will begin submitting URLs automatically based on your sitemap and automation settings. 🔑 How to Set Up the Authority URL Indexer (GCP Required) If you specifically want to use the Authority URL Indexer for bulk Google Indexing API submissions, follow these steps: 1. In your Google Cloud Console, create a new project and enable the Web Search Indexing API. 2. Create a service account and assign it the Owner role, then add the service account email as a verified owner in Google Search Console. 3. Generate and download the JSON key for the service account. 4. Inside Search Atlas, open the URL Indexer tool via the left sidebar → Authority → URL Indexer (URL Indexer). 5. Upload the JSON key file in the designated field and save your configuration. 6. Paste or import the URLs you want to submit and run the indexing job. 🗺️ How Sitemap Indexing Works in OTTO When OTTO Instant Indexing is active, OTTO reads your connected sitemap to identify URLs that should be indexed. You do not need to manually submit individual pages. OTTO monitors your sitemap and queues new or updated URLs for submission automatically through whichever method you have enabled — IndexNow or GSC. To ensure full coverage, confirm that your sitemap URL is correctly entered in your OTTO site settings and that it is publicly accessible. ✅ Quick Decision Guide - Want hands-off, automated indexing through OTTO? Use OTTO Instant Indexing with IndexNow or GSC. No GCP setup needed. - Want to manually submit large batches of URLs via Google's Indexing API with your own GCP account? Use the Authority URL Indexer and complete the GCP and JSON key setup. - Not sure which tool you are in? If you are inside an OTTO session (left sidebar → OTTO SEO → All Sites (SEO Automation)), you are using OTTO Instant Indexing. The Authority URL Indexer is a separate tool with its own navigation entry. 💬 Need Help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
📊 Why GSC Instant Indexing Doesn't Show All Pages
🔍 Overview GSC Instant Indexing is a powerful feature inside Search Atlas that lets you submit URLs directly to Google Search Console for faster indexing. However, many customers notice that not all of their pages appear or can be submitted at once. This article explains exactly why that happens and what you can do about it. 📋 How GSC Instant Indexing Slots Work GSC Instant Indexing operates on a slot-based system tied directly to Google's own API quota limits. Here is what you need to know: - Daily slot limit: Google allows a maximum of 200 URL submissions per day per Google Search Console property through the Indexing API. - Slot reset: Your available slots reset every 24 hours at midnight (UTC). - Per-property limit: Each connected GSC property has its own independent slot quota. If you have multiple properties connected, each one has its own 200-slot daily limit. - Slot consumption: Every URL you submit through GSC Instant Indexing consumes one slot, regardless of whether Google ultimately indexes the page. If you have more than 200 pages to submit, or if your slots are already partially used, some pages will not appear in the submission queue until new slots become available the following day. ❓ Common Reasons Pages Are Not Showing - Daily limit reached: You have already used all 200 slots for the day on that GSC property. - Property not connected: The page belongs to a domain that is not yet linked to a verified GSC property inside Search Atlas. - URL not eligible: The URL may be blocked by a noindex tag, robots.txt, or a canonical tag pointing elsewhere, making it ineligible for submission. - Crawl not completed: Search Atlas has not yet crawled that page, so it has not entered the indexing pipeline. - Duplicate or redirected URLs: Redirect chains or duplicate pages are filtered out automatically to protect your quota. ⚡ OTTO Instant Indexing: The Alternative for Larger Sites If your site has hundreds or thousands of pages and the 200-slot daily limit is a bottleneck, OTTO Instant Indexing is the recommended solution. OTTO is Search Atlas's AI-powered SEO automation engine, and its Instant Indexing feature works differently from the standard GSC method. Here is how OTTO Instant Indexing compares: - Higher throughput: OTTO uses multiple indexing channels beyond Google's standard Indexing API, allowing it to process significantly more URLs without being constrained by the 200-slot daily cap. - Automated prioritisation: OTTO intelligently prioritises which pages to submit first based on SEO value, crawl depth, and content freshness — so your most important pages are always handled first. - Continuous operation: Once activated, OTTO monitors your site for new or updated pages and submits them automatically without manual intervention. - Broader compatibility: OTTO Instant Indexing works across page types including new content, updated content, and pages recovered from indexing errors. 🚀 How to Switch to or Activate OTTO Instant Indexing 1. Log in to your Search Atlas account and navigate to OTTO SEO → All Sites (SEO Automation) from the left-hand menu. 2. Select the website you want to manage and click Activate OTTO if it is not already running. 3. Inside the OTTO dashboard, locate the Instant Indexing panel. 4. Toggle Instant Indexing to On. 5. OTTO will begin auditing your site and automatically queuing eligible URLs for submission. You can monitor progress directly in the panel. If OTTO is already active on your site, check the Instant Indexing toggle to confirm it is enabled. You can also manually add specific URLs to the OTTO submission queue by clicking Add URLs within the panel. ✅ Best Practices for Maximising Indexing Coverage - Use OTTO Instant Indexing for large-scale or ongoing indexing needs and reserve GSC Instant Indexing for targeted, high-priority page submissions. - Prioritise submitting new content and recently updated pages first to make the most of your daily slots. - Ensure all target pages are free of noindex tags, canonical conflicts, and robots.txt blocks before submitting. - Connect all relevant GSC properties inside Search Atlas to maximise the total slot pool available to you. - Check the Indexing Status report in Search Atlas regularly to identify pages that remain unindexed and need resubmission. 💬 Still Need Help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
⚡ Verify Google Instant Indexing Submissions in Search Atlas
What Is Google Instant Indexing? Google Instant Indexing allows Search Atlas to notify Google immediately when a page is published or updated, rather than waiting for Googlebot to crawl it on its own schedule. This speeds up the time it takes for your pages to appear in search results. There are two separate things to verify: submission confirmation (did Search Atlas successfully send the request to Google?) and indexing status (did Google actually index the page?). This article explains what each means and how to get help confirming both. Understanding the Difference: Submission vs. Indexing A confirmed submission means Search Atlas delivered a ping to Google's Indexing API on behalf of your page. It does not guarantee that Google has indexed the page — that decision is made entirely by Google based on its own quality and crawl signals. Because of this distinction, it is normal for a page to show a successful submission in Search Atlas while still not appearing in Google's index immediately. Google typically processes Indexing API requests within hours to a few days, but timing is not guaranteed. What to Have Ready Before Contacting Support Because Google Instant Indexing submission tracking and indexing status details are tied to your specific account and property configuration, a support teammate can investigate and confirm the exact status of your submissions. To get the fastest resolution, have the following ready when you reach out: - The exact URL or URLs you submitted via Google Instant Indexing. - The date and approximate time you submitted them. - The name of the Search Atlas project or site the URLs belong to. - Whether your Google Search Console property is connected and active in Search Atlas. - Any error messages or unexpected statuses you have seen in your account. While You Wait: Check Google Search Console Directly You can independently check whether Google has indexed a specific URL using Google Search Console, which is the authoritative source for indexing status: 1. Log in to Google Search Console and select the property that matches your site. 2. Use the URL Inspection tool and enter the exact URL you want to check. 3. Review the coverage and indexing status Google reports for that URL. If Google Search Console shows the page is not indexed, note the reason provided — this information will also be helpful for the support team. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔗 URL Indexer Plan Requirements and Quota Guide
🗺️ Overview The URL Indexer feature lets you submit URLs directly for faster search engine indexing. Access to this feature depends on your current Search Atlas plan. If your plan does not include URL Indexer, attempting to use or add quota may trigger an HTTP 500 error — this is a plan eligibility issue, not a technical bug. 📋 Which Plans Include URL Indexer? URL Indexer is available on select Search Atlas plans. Not all plan tiers include access to this feature. If you are on an ineligible plan, the feature will be inaccessible and any attempt to add quota may return an HTTP 500 error. To confirm whether your specific plan includes URL Indexer, review your plan details in your account's billing or subscription settings, or contact our support team for clarification. ⚠️ Why Am I Seeing an HTTP 500 Error? An HTTP 500 error when attempting to add Indexer Quota is almost always caused by plan ineligibility, not a platform bug. Specifically, this error can appear when: - Your current plan does not include the URL Indexer feature. - You attempt to purchase or allocate additional Indexer Quota without an eligible base plan. Before troubleshooting the error further, confirm that your plan includes URL Indexer access. If it does not, upgrading your plan is the required first step. 📍 How to Find the URL Indexer If your plan includes URL Indexer, you can access it from within the Search Atlas platform. If the option is missing from your navigation or returns an error when clicked, your current plan likely does not include this feature. ➕ Can I Purchase Indexer Quota Separately? Indexer Quota is an add-on that can be purchased in addition to your existing quota, but it is only available on eligible plans. You cannot purchase standalone Indexer Quota without an active eligible plan. 🔄 How to Resolve the HTTP 500 Error 1. Confirm your current plan by navigating to your account billing or subscription settings. 2. If your plan does not include URL Indexer, upgrade to an eligible plan tier to unlock the feature. 3. Once on an eligible plan, navigate to the URL Indexer section within the platform to access the feature. 4. To add more quota, use the quota management option within the URL Indexer page. 5. If the HTTP 500 error persists after confirming you are on an eligible plan, contact support for further investigation. 💡 Key Reminders - URL Indexer is not available on all plan tiers — check your subscription to confirm eligibility. - Upgrading your plan is required to unlock URL Indexer if your current plan does not include it. - Indexer Quota add-ons require an eligible base plan to purchase. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔍 URL Indexer Report Delays and Job Processing
📋 Overview The URL Indexer submits batches of URLs to third-party indexing services and then polls those services for results. Because the underlying providers require up to 7 full days to process and confirm indexing status, report generation is intentionally delayed until that window closes. Delays during active processing are normal and do not mean your job is stuck. ⏱️ Why Reports Take Up to 7 Days When you submit a batch, Search Atlas sends the URLs to third-party indexing providers. These providers crawl and verify each URL independently. Search Atlas is designed to wait until the full 7-day check window has passed before generating your final report. Polling for results before day 7 is blocked by the platform to prevent incomplete data from appearing in your report. - Days 1–6: Batch is actively being processed by the indexing provider. - Day 7: Search Atlas polls for the completed report and makes it available on your dashboard. 🔎 Common Reasons a Batch May Appear Stuck Even though delays are expected, there are scenarios where a batch can genuinely stall: - Report generation failure: The indexing provider occasionally returns an error when the report endpoint is called too early. Search Atlas retries automatically. - Cron job delay: Background processing jobs run on a schedule. If a job is queued during a high-traffic period, it may take additional time to execute. ✅ What to Check Before Contacting Support 1. Confirm that 7 full calendar days have passed since your batch submission date. 2. Refresh your URL Indexer dashboard and check whether the batch status has updated. 3. Check whether other batches submitted around the same time have completed — this helps identify whether the delay is isolated to one batch or platform-wide. 🛠️ What Search Atlas Does Automatically The platform includes built-in safeguards to handle common processing issues: - Report polling is gated on the 7-day check window — jobs will not attempt to fetch results before the provider is ready. - If a provider returns a report generation error, the system retries the request automatically without any action needed from you. If your batch has not updated after the full 7-day window and the steps above have not resolved the issue, please note your batch submission date and the specific batch name or ID before reaching out. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
⚡ Instant Indexing Requires a Pro, Agency, or Enterprise Plan
📋 Overview Instant Indexing pushes your URLs directly to search engines for faster discovery. This feature is only available on the Pro, Agency, and Enterprise plans. Accounts on lower-tier plans will receive an error when attempting to activate it. ⚠️ Understanding the HTTP 400 Error When you attempt to activate Instant Indexing on an ineligible account, the API returns: - HTTP 400 — "Unable to activate indexing" - is_transient: false — This confirms the error is not temporary or retriable. The account does not meet the plan requirement. This error persists even with the pixel installed, GSC connected, and sitemap registered — plan eligibility is checked separately before activation is allowed. ✅ How to Resolve This 1. Log in to your Search Atlas account. 2. Navigate to the top-right corner (avatar) → Billing → Plans & Top-ups tab (Billing). 3. Upgrade to the Pro, Agency, or Enterprise plan. 4. Once the upgrade is confirmed, return to your OTTO project and activate Instant Indexing again. Your existing OTTO configuration — pixel, GSC connection, and sitemaps — will be preserved after upgrading. 💬 Still need help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔄 URL Indexer Quota Not Resetting After Billing
How URL Indexer Quota Resets Work Most Search Atlas quotas reset automatically on your monthly billing date. However, there is a known issue where URL Indexer credits may fail to refresh on the expected billing date, causing them to appear stale or fully consumed even when you have not submitted URLs recently. Why Your Credits May Show as Fully Consumed If your URL Indexer quota has not reset as expected after your billing date, this is likely related to a platform-level issue affecting credit refresh for the URL Indexer tool. This is a bug that requires investigation by our team on the backend — there are no self-serve steps that will resolve it directly. What to Have Ready When Escalating To help our team investigate and resolve your quota reset issue as quickly as possible, please have the following information ready before reaching out: - Your account email address associated with your Search Atlas subscription. - Your billing date — the date on which your monthly cycle was expected to reset. - The credit amounts displayed — specifically, how many URL Indexer credits are shown as available versus consumed. - Your current plan name, so our team can verify your expected quota allocation. - Any relevant screenshots of the quota display showing the unexpected state. Our team will review your account on the backend and manually trigger or correct the quota reset where needed. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔍 Meta Keywords, Rankings, and Instant Indexing Explained
🧭 Overview Two questions come up frequently among Search Atlas users: do meta keywords still matter for rankings, and can OTTO submit pages for instant indexing? This article answers both clearly so you can make informed decisions about your SEO strategy. 🏷️ What Are Meta Keywords? Meta keywords are an HTML tag that once allowed webmasters to list targeted keywords directly in a page's code. In the early days of search engines, this tag influenced rankings. Today, the landscape is very different. - Google ignores meta keywords entirely. Google officially stopped using the meta keywords tag as a ranking signal in 2009. Adding keywords to this tag has zero positive impact on your Google rankings. - Bing also ignores them for ranking. Microsoft's Bing confirmed it does not use meta keywords as a positive ranking factor either. - They will not hurt you — but they will not help you. Leaving meta keywords blank or removing them from existing pages has no negative effect on your rankings. - They can expose your strategy to competitors. Because meta keywords are visible in your page source code, listing your target keywords there can reveal your SEO strategy to anyone who inspects your HTML. In short: meta keywords are a legacy tag. Focus your efforts on the signals that actually move the needle — high-quality content, title tags, meta descriptions, and structured data. ✅ What You Should Optimise Instead Search Atlas gives you the tools to focus on the on-page elements that Google does use as ranking signals. Prioritise these over meta keywords: - Title tags — the single most important on-page text signal. Keep them under 60 characters and include your primary keyword near the front. - Meta descriptions — do not directly influence rankings, but a well-written description improves click-through rates from search results. - Heading structure (H1–H3) — helps Google understand your page hierarchy and topic relevance. - Body content quality — Google evaluates topical depth, entity coverage, and content helpfulness. - Internal linking — distributes authority and helps Google discover and understand your pages. Search Atlas includes tools to audit and optimise these on-page elements. If you are unsure where to find the relevant features in your account, reach out to our team for guidance on navigating to the right tools for on-page auditing and meta tag generation. ⚡ Does Search Atlas Support Instant Indexing? Yes — OTTO, the Search Atlas OTTO SEO agent, includes an instant indexing capability that allows pages to be submitted for indexing without waiting for a standard crawl. If you have questions about how instant indexing works within your specific OTTO setup or need help confirming that your pages have been submitted correctly, our support team can walk you through the details for your account. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
🔍 Verify OTTO Plugin Meta Edits Are Indexing
🧠 How the OTTO Plugin Applies Meta Edits The OTTO plugin delivers meta title and description changes dynamically at the browser level, not by rewriting your website's backend files or database records. This is expected behaviour — OTTO injects the optimised meta tags into the HTML that is served to visitors and search engine crawlers, without touching your CMS theme files, plugin settings, or source templates. Because of this, you will not see the OTTO-generated meta titles reflected inside your WordPress dashboard, Yoast SEO fields, or any other backend editor. That does not mean the edits are missing — it means they are being applied at the output layer, which is exactly where Google reads them. 🔎 How to Verify OTTO Edits in the Rendered Page Source There is an important distinction between View Page Source and Inspect Element in your browser. Use the steps below to check the correct one. 1. Open the page you want to verify in your browser. 2. Right-click anywhere on the page and select Inspect (or press F12) to open DevTools. 3. Click the Elements tab inside DevTools. 4. Use Ctrl+F (Windows) or Cmd+F (Mac) to search for meta name="title" or title. 5. Confirm the OTTO-generated text appears in the rendered DOM. Why not View Page Source? Pressing Ctrl+U shows the raw HTML before JavaScript runs. Because OTTO injects tags after page load, the raw source may still show your old CMS meta values. The DevTools Elements panel shows the final rendered output — this is what Google's crawler processes. 📊 How to Confirm Google Is Indexing the OTTO Meta Tags Once you have confirmed the tags appear in the rendered DOM, use the following methods to verify Google has picked them up. - Google Search Console — URL Inspection Tool: Paste the page URL into the URL Inspection Tool and click Test Live URL. Scroll to the HTML section and check the meta title Google fetched. This renders JavaScript, so it reflects what OTTO injects. - Google Search Results (site: search): Search site:yourdomain.com/your-page-slug in Google. Once Google has re-crawled the page, the OTTO meta title and description will appear in the snippet. - Search Atlas OTTO SEO V3 Dashboard: Navigate to Left sidebar → OTTO SEO → All Sites (SEO Automation) to review which OTTO optimisations are active and deployed on each URL. ⏱️ How Long Does It Take Google to Reflect the Changes? After OTTO applies meta edits, Google needs to re-crawl the page before the new tags appear in search results. Typical timelines are: - High-traffic pages: A few days to one week. - Lower-traffic or less-linked pages: One to four weeks. You can speed this up by submitting the URL for re-indexing inside Google Search Console → URL Inspection → Request Indexing. ⚠️ Common Reasons OTTO Edits May Not Appear - OTTO is not connected or activated for that specific URL. Verify the connection status in Left sidebar → OTTO SEO → All Sites (SEO Automation). - A conflicting plugin is overriding the output. Caching plugins (e.g. WP Rocket, W3 Total Cache) can serve a cached version that bypasses OTTO's injection. Clear your site cache after activating OTTO edits. - The page is blocked from crawling in your robots.txt file or has a noindex directive set elsewhere in your CMS. - You are checking View Page Source instead of DevTools. Always use the Elements panel in DevTools to see the rendered output. ✅ Quick Verification Checklist 1. Open DevTools (F12) → Elements tab → search for the meta title tag. 2. Confirm the OTTO-generated title is present in the rendered DOM. 3. Clear your site cache if you recently activated OTTO. 4. Use Google Search Console URL Inspection → Test Live URL to see what Google fetches. 5. Request re-indexing for priority pages via Search Console. 6. Check OTTO activation status in Left sidebar → OTTO SEO → All Sites (SEO Automation). 💬 Need More Help? If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
⚡ GSC Instant Indexing, Knowledge Base & Bulk Deployment Guide
Overview After upgrading your plan, you unlock several powerful features, including GSC Instant Indexing, Knowledge Base Trust with Factual Enhancement, and bulk deployment to your live site. Dynamic Indexing is also available to any account with OTTO. This article explains what each feature does and how to get started. Because exact quota limits, reset schedules, and specific configuration options can vary by account, this article explains where to find these tools and what to have ready when you contact support if you need account-specific details confirmed. GSC Instant Indexing — Quota and Usage GSC Instant Indexing lets you submit URLs directly to Google Search Console for faster crawling and indexing. The exact monthly quota and reset schedule for your account depend on your specific plan configuration and billing cycle — these figures are not the same for every account. To check your quota and submit URLs: 1. Log in to Search Atlas and open the GSC Instant Indexing section of the platform. 2. Your current usage and remaining quota are displayed within that section — review them there before submitting. 3. Select the URLs you want to submit and follow the on-screen prompts. If your quota usage looks incorrect, submissions are not processing, or you need your exact quota limit and reset date confirmed, have the following ready before contacting support: your account name, the URLs you attempted to submit, any error messages displayed, and the approximate date and time of the issue. Knowledge Base Trust — AI Generation and Factual Enhancement Knowledge Base Trust allows the platform's AI to generate and enhance content. Factual Enhancement is a capability within this workflow that influences how the AI aligns its output with sources you have added to your Knowledge Base. To get started with Knowledge Base Trust: 1. Navigate to OTTO SEO → Knowledge Base. 2. Add your trusted knowledge sources using the options available in that section. 3. When generating content, follow the on-screen options available in that workflow to enable Factual Enhancement so the AI references your added sources. 4. Review all generated content in the review area before approving or publishing it. If you cannot locate the Factual Enhancement options, the review area, or your added sources are not appearing as expected, contact support with your account name and a description of what you see on screen. Bulk Deployment and Dynamic Indexing Bulk deployment is an additional Growth plan tool accessible within the Search Atlas platform. Dynamic Indexing is available to any account with OTTO, subject to the OTTO project being set up (and any connected indexing services). Because the exact steps to initiate these features depend on how your site connector and content projects are configured, the specific workflow will vary by account. When contacting support about bulk deployment or Dynamic Indexing, have the following ready: your account name, the name of the relevant content project or site connector, a description of the action you are trying to take, and any error messages or unexpected behavior you have observed. If you need further assistance, open the chat widget in the bottom-right corner of the platform and type human teammate to be connected with a member of our team.
⚡ The Complete Guide to Indexing in Search Atlas (Instant, Dynamic & Authority Indexer)
Search Atlas gives you multiple indexing workflows, each designed for different SEO scenarios. If you’ve ever published a page and waited days (or weeks) for Google to crawl it… this is where that waiting stops. This guide explains: - 🔥 Instant Indexing (real-time submission) - 🧠 Dynamic Indexing (re-submit pages that are indexed but receiving zero impressions in Google Search Console, so Google re-evaluates and potentially ranks them) - 🏗 Authority → URL Indexer (batch submission workflow) - 🛠 Advanced strategies & troubleshooting 📍 Navigation Paths Instant Indexing: Left Sidebar → OTTO SEO → All Sites → Select your Site → Scroll to Recommendations → Left Panel → Indexing → Instant Indexing Dynamic Indexing: Left Sidebar → OTTO SEO → All Sites → Select your Site → Scroll to Recommendations → Left Panel → Indexing → Dynamic Indexing Authority → Indexer (URL Indexer): Left Sidebar → Authority → Indexer (URL Indexer) 🚀 What Is Instant Indexing? Instant Indexing connects directly to: - Google Search Console (GSC) - Bing IndexNow It allows you to submit URLs immediately for crawling and indexing. Instead of waiting for Google to “discover” your page, you notify search engines proactively. 🧩 Two Methods Inside Instant Indexing 1️⃣ Sitemap-Based Indexing Submit entire sitemaps for indexing. You’ll see: - Pages count - Awaiting Indexation - Indexed - GSC / IndexNow toggles - Add Sitemap option About the GSC / IndexNow toggles: Toggle GSC on to submit via Google Search Console. Toggle IndexNow on to simultaneously notify Bing. Both can be enabled at the same time for maximum coverage. Best for: - Large websites - Ecommerce - CMS with structured sitemaps - Ongoing indexing management 2️⃣ Custom URL-Based Indexing Submit specific URLs manually. You can: - Add individual URLs - Perform bulk actions - Toggle GSC or IndexNow - Track submission status IndexNow submission statuses (recently added): Submissions now display an explicit status — accepted, pending, or failed. If a submission shows as failed, retry the submission; if it continues to fail, contact support so we can investigate. Best for: - New blog posts - Updated landing pages - Time-sensitive content - Campaign launches 🔗 Connect Google Search Console (GSC) for Instant Indexing Instant Indexing can submit URLs to Google (via GSC) and Bing (via IndexNow). GSC and IndexNow can be toggled independently per sitemap or URL submission. To submit to Google, Search Atlas needs the correct permission level inside your Google Search Console property. ✅ What you’re actually doing You’re granting Search Atlas access to submit indexing requests on your behalf. That permission is tied to the exact GSC property you connect (usually your domain property). In the UI, this appears as an “Enable indexing access” prompt. 📍 Where this setup appears Inside Instant Indexing, you’ll see a setup panel/modal titled: Enable indexing access It has a simple 2-step flow. Step 1 — Copy your unique address You’ll see a field labeled something like: Copy your unique address - You can click Generate (to create one automatically), or paste an existing one if you already have it. - Then copy it using the copy icon. Think of this as the “account identifier” Search Atlas needs to be added into your GSC property. Step 2 — Add it to your Google Search Console property as an Owner Right below, the UI tells you exactly what to do: 1. Click Open GSC 2. In Google Search Console, open the correct property (commonly a domain property like sc-domain:yourdomain.com) 3. Go to Settings → Users and permissions 4. Click Add user 5. Paste the unique address you copied 6. Set permissions to Owner Why Owner matters: Instant Indexing needs the ability to submit indexing actions consistently across the property. Lower permission levels can cause verification failures or partial capability. Final step — Verify & enable access Back in Search Atlas, click: ✅ Verify & Enable access If successful, Search Atlas confirms indexing access and Instant Indexing can begin submitting requests. Common GSC setup mistakes (and how to avoid them) ❌ Adding the user to the wrong property Make sure you’re adding it to the exact property you’re indexing (domain vs URL-prefix matters). ❌ Not using Owner permissions If it’s not Owner, verification may fail or submissions may not work reliably. ❌ Multiple GSC accounts / wrong Google login If you’re logged into several Google accounts, GSC might open the wrong one. Confirm you’re in the correct account before adding permissions. 🔵 Bing IndexNow Setup Bing IndexNow is a separate channel from Google. It requires you to prove domain ownership by hosting a verification key on your website. In the UI, this appears as a modal titled: API key ✅ What you’re doing You’re adding an IndexNow API key to your website so Bing can verify that Search Atlas is allowed to submit URLs for that domain. Step 1 — Copy your API key You’ll see a field labeled: API Key Copy the key shown there. Step 2 — Host your API key at your domain root The UI describes two methods: Manual Installation and 1-Click Install (if eligible). ✅ Manual Installation (works for any site) You must create a plain text file and upload it to the root of your website. Rules that must be followed exactly: - Create a UTF-8.txt file - Filename must be the API key (exactly) - File content must be the same API key (exactly) - Upload it to your site’s root (top-level directory) 🎯 Instant Indexing in Landing Page Studio (LPS) When publishing a site in Landing Page Studio, users with a custom domain will see an opt-in Instant Indexing toggle directly in the Publish flow. What it does: When enabled, Search Atlas automatically submits the published URLs for indexing as soon as the site goes live — so you don’t have to add them manually inside Instant Indexing afterward. Important: This toggle is gated to custom domains. If you’re publishing on a default Search Atlas subdomain, the toggle will not appear in the Publish flow. 🧠 Dynamic Indexing What it is Dynamic Indexing identifies pages on your site that have been indexed but are receiving zero impressions in Google Search Console, and re-submits them to prompt Google to re-evaluate and potentially rank them. How to use it 1. Navigate to OTTO SEO → All Sites → select your site → Recommendations → Indexing → Dynamic Indexing. 2. Search Atlas will surface eligible URLs (indexed but zero impressions). 3. Review the list and submit the pages you’d like Google to re-evaluate. Best use cases - Pages that are technically indexed but “invisible” in search - Older content that has gone stale in rankings - Pages updated with new content that need to be re-evaluated - Sites with long-tail pages that struggle to gain visibility 🏗 Authority → URL Indexer (Batch Submission Workflow) What it is The URL Indexer (inside Authority Building) lets you submit URLs in batches for indexing. It’s designed for higher-volume workflows where you need to push many URLs through at once. Batch submission workflow 1. Go to Left Sidebar → Authority → Indexer (URL Indexer). 2. Paste or upload your list of URLs. 3. Start the batch job. Search Atlas processes the URLs and submits them for indexing. Credit usage Each URL submitted through URL Indexer consumes credits from your account. See the Credits & Billing section below for details on how credits are consumed and what to do if you lose credits to an error. Status tracking Each URL in a batch shows its current submission state so you can see what has been processed and what is still in progress. 💳 Credits & Billing (URL Indexer) How credits are consumed Each URL submitted through the Authority → URL Indexer consumes credits from your account balance. Credits are deducted at the time the job runs. What happens if a job fails or errors mid-run If a job fails part-way through, or if a platform error (for example, an Atlas Brain connection error) causes a job to be retried, credits may still be consumed across each run. This can result in credits being spent on incomplete or duplicated work. Requesting a credit refund If credits were consumed due to a platform error (not user action), contact Search Atlas Support with: - The date/time of the affected job - The number of credits consumed - A brief description of the error you encountered Support will investigate and, if confirmed, refund the credits to your account. 🛠 Troubleshooting & Known Issues Custom URL submissions not visible in the list If you add a URL via Custom URL-Based Indexing and it does not appear in the list immediately, this is a known display/refresh issue. Your URL has been submitted — use the search bar at the top of the list to confirm it is present. A fix is in progress. Submission limits & quotas Indexing capacity has recently been expanded across the platform. For current submission limits or quota questions specific to your account, please contact Search Atlas Support.
URL Indexer Quota Not Resetting After Renewal
Understanding the Issue After your billing cycle renews, you may notice your URL Indexer quota still appears fully used and is preventing you from submitting new URLs. This can happen because the URL Indexer includes two distinct types of quota that behave differently at renewal. Recurring vs. Non-Recurring Quota Explained Your URL Indexer quota is made up of two separate allocations: - Recurring quota: A set number of URL indexing credits included in your plan that automatically renew each billing cycle. - Non-recurring quota: Additional credits purchased separately as a one-time top-up. These do not reset or replenish at renewal — once used, they are gone. If your counter does not reset as expected after renewal, it is likely because the bulk of your available quota came from a one-time purchase that has already been fully consumed. The smaller recurring portion from your plan will still be added on your renewal date, but this may not be enough to visibly change a near-full counter. What Happens at Billing Renewal On your renewal date, Search Atlas automatically adds your plan's recurring URL Indexer credits to your account. This happens in the background — you do not need to take any action to trigger it. However, if your counter still appears maxed out after renewal, it is most likely because: - Your non-recurring (purchased) credits were already fully used before renewal. - The recurring credits added at renewal are a small number relative to your total limit, so the counter may still appear nearly full. How to Check Your URL Indexer Usage 1. Navigate to the URL Indexer section of your Search Atlas account. 2. Review your current quota usage to confirm how many credits remain. 3. Check whether your billing renewal date has passed — if it has and your quota still appears blocked, your recurring credits may not have been applied yet, or you may need additional credits. How to Get More URL Indexer Credits If your recurring plan credits are not sufficient for your needs, you have two options: - Upgrade your plan: A higher-tier plan may include a larger recurring URL Indexer quota each month. - Purchase a top-up: You can buy additional non-recurring credits. Keep in mind that these are a one-time addition and will not renew automatically. To explore upgrade or top-up options, please contact our support team who can assist you with the available choices for your account. Still Need Help? If your quota does not appear to have updated after your renewal date, or you are unsure which type of credits were consumed, reach out to our support team via the chat icon in your account and we will investigate your quota status directly.
🔍 URL Indexer (Instant Indexing): Why URLs Aren't Processing (Google Cloud Project Required)
🚫 Why your URLs show zero progress The Search Atlas URL Indexer (also referred to as Instant Indexing within Search Atlas) submits your pages to Google's official Indexing API. To use this API, Google requires a verified Google Cloud Project (GCP) with the Indexing API enabled. Without this setup, your URL submissions never reach Google. ⚙️ How to set up your Google Cloud Project 1. Go to console.cloud.google.com and sign in with your Google account 2. Create a new project (or select an existing one) 3. Go to APIs & Services > Library 4. Search for Indexing API and click Enable 5. Go to APIs & Services > Credentials 6. Create a Service Account and download the JSON key file 7. Add the service account email as an Owner in your Google Search Console property 8. In Search Atlas, go to Indexer > Settings and upload the JSON key file ✅ After connecting Once your GCP is connected, resubmit your URLs. You should see them move from Pending to Processing within a few minutes. 🛠️ Troubleshooting activation errors If you connected an existing Google Cloud Project and Instant Indexing activation failed, or you saw a server error when enabling indexing, these were known issues that have since been fixed. First make sure a project is assigned to your GCP connection, then retry activation. If errors persist after retrying, contact support. ⚠️ Important: indexing is still controlled by Google Submitting a URL to the Indexing API does not guarantee immediate indexing. Google evaluates each URL for content quality, crawlability, and authority before indexing it. Most URLs are crawled within 24-96 hours of submission.
🔍 URL Indexer: Why Your Pages Are Not Indexed Yet (And What Google Actually Controls)
✅ What the URL Indexer does — and doesn't do The Search Atlas URL Indexer submits your pages to Google's official Indexing API, which signals to Google that a URL is ready to be crawled. This is the fastest official method to request indexing. However, Google makes the final decision on when and whether to index any page. 🤔 Why your page may not be indexed after submission - Content quality — thin, duplicate, or low-value content is often not indexed - Crawlability — the page must be accessible to Googlebot (check robots.txt and noindex tags) - Domain authority — new or low-authority sites get indexed more slowly - Canonical structure — if a page has a canonical tag pointing elsewhere, Google may skip it ⏱️ Realistic indexing timelines - High-authority sites: hours to 24 hours after submission - Medium-authority sites: 1-4 days - New or low-authority sites: 4-14 days, sometimes longer 🔄 If the Indexer shows "Not Indexed" but the page appears in Google The Indexer's indexation status is refreshed on a periodic cycle (status checks run roughly once per hour), so a recently indexed page can still show as Not Indexed until the next refresh. In some past cases the status was also reported prematurely or pulled from stale API data before a submission had fully finalized, which caused already-indexed URLs to be mislabeled — these reporting issues have since been fixed. If a page shows Not Indexed in the URL Indexer, confirm the true status in Google Search Console > URL Inspection, which reflects Google's own index. If GSC shows the page as indexed, treat the Indexer status as out of date and allow it to refresh. If submissions appear to never process or trigger indexing at all, this is a separate known issue under review — contact Search Atlas support so your case can be checked. 🚀 How to improve your chances of indexing 1. Use Google Search Console > URL Inspection to check for crawl or indexing issues 2. Ensure the page has unique, substantive content 3. Add the page to your XML sitemap and submit the sitemap in GSC 4. Build internal links to the page from already-indexed pages
🔗 Understanding URL Indexer Timelines and Expectations
📋 Overview The URL Indexer tool in Search Atlas accelerates the submission of your URLs to Google's indexing pipeline. However, submission and indexation are two different things. Submitting a URL signals to Google that the page exists and is ready to be crawled — but Google alone decides whether, and when, to index it. This article explains the distinction between submission and indexation, sets realistic timelines, and provides steps you can take if your URLs remain unindexed after several weeks. 🗺️ How to Access the URL Indexer 1. Log in to Search Atlas. 2. Navigate to the URL Indexer tool in your dashboard. ⚙️ Submission vs. Indexation: What's the Difference? These two terms are often confused, but they describe separate stages in the process: - Submission: Search Atlas sends your URLs to Google's Indexing API or ping services. This step confirms that Google has been notified about the URL. It happens quickly — usually within minutes to hours of you submitting the batch. - Indexation: Google crawls the URL, evaluates its quality and relevance, and decides whether to add it to its search index. This step is entirely controlled by Google and cannot be forced or guaranteed by any third-party tool. A "submitted" status in the URL Indexer means your URLs were successfully sent to Google — not that they have been indexed. 📅 Realistic Indexing Timelines Indexing speed varies widely depending on the type of URL you submitted. Use the table below as a general guide: - High-authority, frequently crawled domains (e.g., your main website): A few days to 1–2 weeks. - New or less-established domains: 2–4 weeks on average. - Web 2.0 properties (e.g., Blogger, WordPress.com, Weebly): 2–4 weeks or longer — sometimes 6–8 weeks in practice. Google crawls these domains less frequently and applies stricter quality filters. - Low-quality or thin-content pages: May never be indexed, regardless of submission method. If your URLs were submitted fewer than 10 days ago, it is entirely normal for them to show no indexing activity yet, especially for Web 2.0 properties. Waiting the full 2–4 week window before troubleshooting is strongly recommended. ❓ Why Google May Not Index a Submitted URL Submission does not guarantee indexation. Google may choose not to index a URL for a number of reasons: - The page has thin, duplicate, or low-quality content. - The domain has low authority or very few inbound links. - The page has a noindex directive in the meta tag or HTTP headers. - The page is blocked in robots.txt. - The URL returns a non-200 HTTP status code (e.g., redirect loop, 404, or server error).