.Google restricts robots.txt assistance to 4 areas, clarifying its own posture on unsupported regulations.Google.com just sustains four certain robots.txt areas.In need of support instructions in robots.txt will definitely be ignored.Look at bookkeeping your robots.txt data because of this improve.