ChatGPT-5 will be written by ChatGPT4? :)

if I've been reading it correctly, the power of chatgpt is in the training and data, not necessarily the algorithm.

And I'm not sure if it's technically possible for one AI to train another AI with the same algorithm and have better performance. Although I could be wrong about any and everything. :-)

A LLM by itself could generate data, code and iterate on its training process, thus it can create another LLM from scratch. There is a path to improve LLMs without organic text - connect them to real systems and allow them feedback. They can learn from feedback from their actions. It could be as simple as a Python execution environment, a game, simulator, other chat bots, or a more complex system like real world tests.

I know that NVidia is using AI that is running on NVidia chips to create new chips that they then run AI on.

All you have left to do is to AI the process of training AI, kind of like building a lathe by hand makes a so-so lathe but that so-so lathe can then be used to build a better and more accurate lathe.

I actually love this analogy. People tend to not appreciate just how precise modern manufacturing equipment is.

All of that modern machinery was essentially bootstrapped off a couple of relatively flat rocks. Its going to be interesting to see where this LLM stuff goes when the feedback loop is this quick and so much brainpower is focused on it.

One of my sneaky suspicions is that Facebook/Google/Amazon/Microsoft/etc would have been better off keeping employees on the books if for no other reason than keeping thousands of skilled developers occupied, rather than cutting loose thousands of people during a time of rapid technological progress who now have an axe to grind.

It is a nice analogy because you can expand it really to all history of technological progress. Tools help make tools - all the way back to obsidian daggers and sticks.

Same goes for the bellybutton, that navel connected from one living being to another, back to the first mamal.

I know this is a joke but electronics cause an unmeasurably small amount of heat dissipation. It's how we generate power that's the problem.

Or what answers we ask the electronics for... "Univac, how do I increase entropy?" distant rumble of cooling fans

You mean decrease entropy?

We'll work up to that. For now, there's insufficient data for meaningful answer.