Google Guidelines

https://support.google.com/webmasters/answer/35769?hl=en

Help Google find your pages
  • Ensure that all pages on the site can be reached by a link from another findable page. The referring link should include either text or, for images, an alt attribute, that is relevant to the target page. Crawlable links are <a> tags with an href attribute.
  • Provide a sitemap file with links that point to the important pages on your site. Also provide a page with a human-readable list of links to these pages (sometimes called a site index or site map page).
  • Limit the number of links on a page to a reasonable number (a few thousand at most).
  • Make sure that your web server correctly supports the If-Modified-Since HTTP header. This feature directs your web server to tell Google if your content has changed since we last crawled your site. Supporting this feature saves you bandwidth and overhead.
  • Use the robots.txt file on your web server to manage your crawling budget by preventing crawling of infinite spaces such as search result pages. Keep your robots.txt file up to date. Learn how to manage crawling with the robots.txt file. Test the coverage and syntax of your robots.txt file using the robots.txt testing tool.
Ways to help Google find your site:

Comments

Post a Comment

Popular posts from this blog

crawlable links (Google guidelines)

Make your links crawlable Google can follow links only if they are an  <a>  tag with an  href  attribute. Links that use other formats won't be followed by Google's crawlers. Google cannot follow  <a>  links without an  href tag or other tags that perform as links because of script events. Here are examples of links that Google can and can't follow: Can follow: <a href="https://example.com"> <a href="/relative/path/file"> Can't follow: <a routerLink="some/path"> <span href="https://example.com"> <a onclick="goto('https://example.com')">
Read more

What are Sitemaps files?

https://www.sitemaps.org/index.html   What are Sitemaps? Sitemaps are an easy way for webmasters to inform search engines about pages on their sites that are available for crawling. In its simplest form, a Sitemap is an XML file that lists URLs for a site along with additional metadata about each URL (when it was last updated, how often it usually changes, and how important it is, relative to other URLs in the site) so that search engines can more intelligently crawl the site. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow crawlers that support Sitemaps to pick up all URLs in the Sitemap and learn about those URLs using the associated metadata. Using the Sitemap  protocol  does not guarantee that web pages are included in search engines, but provides hints for web crawlers to do a better job of crawling your site. Sitemap 0.90 is offered under the terms of the  Attribution-ShareAl...
Read more