Also some hosting suppliers incorporate limitations within the robots.txt to ensure that search engine crawlers don’t crawl Web sites daily, so it’s a good idea to Look at Those people settings also. . The truth is, we don't know how many inbound links Google ignores, nevertheless