to stop unwanted information in the search indexes, webmasters can instruct spiders never to crawl particular documents or directories through the standard robots.txt file in the root Listing from the domain. Also, a https://www.fiverr.com/akashpatteri/seo-guest-post-with-do-follow-backlink