Instead of having the LLM generate the links couldn’t you use a combination of keyword matching and similarity on the model output and the results to automatically add citations? You could use a smaller NLP model or even a rule based system to extract entities or phrases to compare. I’m sure this is already being done by bing for example.
You definitely can do that. It’s just sometimes simpler to dump lots of stuff in context and then check it wasn’t made up.
It like the idea of using markdown footnotes. I think that would word well - ChatGPT does handle markdown really well.
