To your knowledge, is it against the law to not follow a site's robots.txt? I'm ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

IanDrake on July 24, 2012 | parent | context | favorite | on: Craigslist Suing Padmapper

To your knowledge, is it against the law to not follow a site's robots.txt? I'm not aware of one, but I am curious.

debacle on July 24, 2012 | [–]

I don't know if it's illegal, but Google would follow the site's robots.txt.

BenOfTomorrow on July 24, 2012 | [–]

Ambiguous. See http://news.ycombinator.com/item?id=4286857.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact