How do I index a site map?
Sitemap can be helpful in pointing our crawler to webpages that are not internally linked within your website. When you add a new domain, we look for a sitemap at the root (e.g. www.website.com/sitemap.xml) of the domain and index all the links on the sitemap.
Follow these steps to add your sitemap to your collection:
- Check if the sitemap exists on your website by going to www.yourwebsite.com/sitemap.xml. If sitemap is already present, skip to 3.
- If sitemap is missing, then ask your website developer or technical team to add sitemap to your website.
- The name of the sitemap must end with "sitemap.xml" in order to be crawled. It can be located under any directory (e.g. www.yourwebsite.com/site/first-sitemap.xml)
- Log in to your console and select the relevant collection.
- Navigate to Domains section and click on "Diagnose".
- Enter the URL of the sitemap, e.g. www.yourwebsite.com/sitemap.xml as the URL and press "Diagnose".
It will return a message "Page not found in the index." Press "Add to Index".
The sitemap will be indexed and it might take a few minutes or a few hours depending on the amount of pages on your website and load in our index queues.
If you click on "See extended debug information", you might see a MIME error on the Page Debug tool. This error can be ignored, and your sitemap and all the links on your sitemap will be indexed.