Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

So is my knowledge of newtons law of cooling


If an LLM has only that knowledge and nothing else (pieces of text saying that heat transfer is proportional to some function of the temp difference) such that is not trained on any texts that give problems and solutions in this area, it will not work this out, since it has nothing to generate tokens from.

Also, your knowledge doesn't come from anywhere near having scanned terabytes of text, which would take you multiple lifetimes of full time work.


We get way more info than llms do, just not solely from text


You have not read every accessible piece of text in existence.


There is more to life than just text e.g. this is part of lecun argument against LLMs


Lecun's argument is based off a bad interpretation of how data is processed by the optic nerve, we don't receive that much raw data.

What we do have, is billions of years of evolution that has given a lot of innate knowledge which means we are radically more capable than LLMs despite having little data.


There is more to text than just predicting tokens based on a vast volume of text.

There isn't an argument "against LLMs" as such; the argumentation is more oriented against the hype and incessant promotion of AI.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: