Google SearchGoogle wants to turn the Robot Exclusion Protocol( REP) into an official internet standard — and it’s inducing its own parser open source to help.Read More

Read more: venturebeat.com