I'm over simplifying here but graph database and knowledge graphs exist. An LLM doesn't need to preserve everything in context, just what it needs for that conversation.
Unless there is a trick that I am missing, I don't think this will work by itself. The fundamental thing is what can the model attend to as it generates the next token.
If you give a summary+graph to the model, it can still only attend to the summary for token 1. If it's going to call a tool for a deeper memory, it still only gets the summary when it makes the decision on what to call.
You get the same problem when asking the model to make changes in even medium-sized code bases. It starts from scratch each time, takes forever to read a bunch of files, and sometimes it reads the right stuff, other times it doesn't.
The more important question appears to be why it seems to difficult to follow the advice?
Personally, I'm well aware of the positive effects of drinking plenty of water, eating vegetables, exercising daily, and going to bed early. However, I buy myself a chocolate bar every day, love pizza, just want to unwind after a hard day at work, and still read Reddit late into the night.
All the healthy stuff has friction: a workout takes time out of the day, the veggies need preparation, while going to bed early means I'm missing out on fun or intriguing things that I would learn about otherwise.
It's probably easier to monetize chocolate bars, pizza and reddit (ads). Easier to slip into "junk" mode and harder to stop.
My exercise equipment is long paid for (10+ years ago), I watch sports while exercising (subscription paid whether I exercise or not) and going to bed early means less need for caffeine / painkillers to get through the day. Veggies are somewhat more expensive, not sure if the margins are as high on them as on ultra-processed food.
And yet, I'm right there with you - I struggle daily with doing the right thing.
It's the signal that they have no idea what they're talking about. Always remember everything doctors said people should do to cure their stomach ulcers: the "why not?" list.
"Your medical team has carefully gone over the results of your tests, and we've finally come to the careful consensus that you should keep active, drink more water, get enough sleep but not too much, and eat your vegetables."
"But..."
"Why not? Do you think vegetables are bad for you?"
This was a large multi centre prospective RCT; so I would say that it adds to evidence from other sources acquired in less rigorous ways. This was also a structured multidisciplinary intervention; so this study may add to what can be done in terms of implementation, because there is still work to be done on that front. But yes, at face value, it sounds like what we already know! (But which many/most are not implementing…)
Instead of berating people or repeating messages over and over, let's focus on getting GLP-1 and GIP receptor agonists into as many people's hands as possible.
lol yeah let’s fund more pharma bull shit and kick the can for actually solving the problem. More CEOs need yachts. Diet education and curbing the corps poisoning us is far more effective.
How come it's so hard for people to drink water? Honest question. Like why don't you just wake up in the morning, take a whiz, brush your teeth, and drink a glass of water?
What gets in between? Because the first two are 99% success rate I'd bet.
But is that bad? Do people actually need to drink more than they are thirsty for? Why is it that our hunger sense is over-tuned, but conventional wisdom says that our hydration sense is under-tuned?
Honestly, I feel like "always be drinking" only appeared once bottled water did.
Honestly I forget brushing more than I should too, and I skip breakfast most days even though I'm hungry. The friction required to pour the glass or set things up can be a lot early in the morning.
It helped me to get a water cooler or something to fill a bottle?
As an immigrant to the USA teaching in this country is a mess. Teachers apply a lot of semi scientific mumbo jumbo to justify a completely inadequate amount of work required from students to learn.
I know it's not popular to say it but my son learns anything I teach him, he might not enjoy the process very much but he never forgot anything I taught him because I make him work. His teachers don't make him do anything with the results you can imagine. If you point it out they say if they did parents would complain.
> I know it's not popular to say it but my son learns anything I teach him
1. Remember that you are looking at an experiment with n=1.
2. It sounds like you think the key to education is coercion. ("His teachers don't make him do anything...".) That's a grim world, too.
Also, I hope you are looking at your home country's educational system with clear eyes.
Not to say I disagree that the US educatonal system is a mess. If you stopped at your second sentence I would entirely agree.
As you went on, I started to wonder if you had an experience teaching your child something that was difficult for them. It's not just _forgetting_ that makes learning difficult.
> It sounds like you think the key to education is coercion. ("His teachers don't make him do anything...".) That's a grim world, too.
Of course education is coercion. Same way work is things you do for money. Education without coercion is just learning, at best.
Teachers are there because of the coercion they provide. Even in the US they coerce kids to at least sit in class, because if they didn't kids would just walk out and go learn how to properly light up a cigarette from some older kid.
if a kid is being lazy there's simply no way around "cohercion" as you put it. You know how I know he's being lazy? Because I used to do the same stuff for the same reasons, and my parents and teachers saw through it and didn't make excuses for me or any other kid.
We were expected to grow up and learn to do work even when we didn't want to.
When I was in kindergarten, we were read a book called The Little Old Man Who Could Not Read. The main character was a Mr. Magoo-type character, except merely illiterate instead of functionally blind. He was always making mistakes like this, for example buying wax paper instead of spaghetti because they both came in long boxes. Eventually his wife teaches him how to read and his next grocery trip has all the correct items.
reply