Also some web hosting companies increase restrictions from the robots.txt to make sure that online search engine crawlers don’t crawl Sites everyday, so it’s a smart idea to Check out People settings too.. In fact, we don't know the amount of inbound links Google ignores, but it really's excellent t