this new model that facebook is trying to push isn't scalable. it favors the big guys and it's bad for the open web.
you shouldn't have a TOS that contradicts your robots.txt. period.
this new model that facebook is trying to push isn't scalable. it favors the big guys and it's bad for the open web.
you shouldn't have a TOS that contradicts your robots.txt. period.