Man I really have to stop reading hackernews comments, its a total bummer.
His companies are making rockets, autonomous humanoid robots and autonomous cars, I will cut my left pinky finger to work on any of those, and this is my capslock finger, so I will have to switch away from emacs..
With the worldlabs[1] work maybe they unlock models that do have even better spatial world model and can be used label data even better and faster, or create even better synthetic data so it can unlock FSD even sooner.
The fact that LLMs work means there is structure in language that is beyond our understanding, and yet the transformer can discover it and program itself to solve for it. I think that the stupendous amount of compute that is going to be released in 2025 will make it possible to train labelers that can do temporal labeling much better than humans and than the current models, and synthesize and perturb data to train really really good transformers that will outperform 90th percentile humans.
Why do you guys think that it can not happen? Maybe its not Tesla that does it, but I certainly think amazing tech is coming.
Hopefully it will not be just autonomous humanoid robots with guns paid by the military and patrolling the borders :astonished face:
His companies are making rockets, autonomous humanoid robots and autonomous cars, I will cut my left pinky finger to work on any of those, and this is my capslock finger, so I will have to switch away from emacs..
With the worldlabs[1] work maybe they unlock models that do have even better spatial world model and can be used label data even better and faster, or create even better synthetic data so it can unlock FSD even sooner.
The fact that LLMs work means there is structure in language that is beyond our understanding, and yet the transformer can discover it and program itself to solve for it. I think that the stupendous amount of compute that is going to be released in 2025 will make it possible to train labelers that can do temporal labeling much better than humans and than the current models, and synthesize and perturb data to train really really good transformers that will outperform 90th percentile humans.
Why do you guys think that it can not happen? Maybe its not Tesla that does it, but I certainly think amazing tech is coming.
Hopefully it will not be just autonomous humanoid robots with guns paid by the military and patrolling the borders :astonished face:
[1]: https://www.youtube.com/watch?v=vIXfYFB7aBI (Fei-Fei Li and Justin Johnson)