Correct, AGI refers to a level of AI development where the machine can understand, learn, and apply its intelligence to any intellectual task that a human can, a benchmark GPT-4 hasn't reached.
What actually happened between GPT3 and GPT4 was so called RLHF, which basically means fine tuning base model with more training data, but structured so it can learn instructions and that's all there was really + some more params to get better performance. Besides that making it multi modal (so basically sharing embeddings in the same latent space).
Making it solve graduate level math is a lot different than dropping some more training data at it. This would mean they changed the underlying architecture, which actually could be a breakthrough.
What actually happened between GPT3 and GPT4 was so called RLHF, which basically means fine tuning base model with more training data, but structured so it can learn instructions and that's all there was really + some more params to get better performance. Besides that making it multi modal (so basically sharing embeddings in the same latent space).
Making it solve graduate level math is a lot different than dropping some more training data at it. This would mean they changed the underlying architecture, which actually could be a breakthrough.