Robots.txt is usually a file that exists on the basis Listing of every Internet site and can be used to instruct serps on which directories/files of the web site they can crawl and contain of their index. Serps have one target only. They intention to offer end users with one https://news.rafeeg.ae