To avoid unwanted information during the search indexes, site owners can instruct spiders to not crawl sure information or directories from the typical robots.txt file in the basis directory in the area. Also, a webpage could be explicitly excluded from the search engine's databases through the use of a meta https://news.rafeeg.ae