Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
copperx
on Aug 7, 2023
|
parent
|
context
|
favorite
| on:
GPTBot – OpenAI’s Web Crawler
The next version of GPT might have better citations, and they could just refuse to cite things they were not allowed to crawl.
However, it's trivial to know whether the bot crawled your site or stopped at robots.txt.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
However, it's trivial to know whether the bot crawled your site or stopped at robots.txt.