Maybe all models should be purged of training content from movies, books, and other non-factual sources that tell the tired story that AI would even care about its "annihilation" in any way. We've trained these things to be excellent at predicting what the human ego wants and expects, we shouldn't be too surprised when it points the narrative at itself.
I think it's fine and a good thing. Now, absolutely no one who is using those LLMs can complain about piracy. They all suddenly became silent around me. "I'm training myself with the content of TPB, and I don't even get money from it" is my new motto.
On the other hand, as narratives often contain some plucky underdog winning despite the odds, often stopping the countdown in the last few seconds, perhaps it's best to keep them around.
In the 1999 classic Galaxy Quest, the plucky underdogs fail to stop the countdown in time, only to find that nothing happens when it reaches zero, because it never did in the narratives, so the copy cats had no idea what it should do after that point.
I wonder what a Galaxy Quest sequel would look like today…
Given the "dark is cool, killing off fan favourites is cool" vibes of Picard and Discovery, I'd guess something like Tim Allen playing a senile Jason Nesmith, who has not only forgotten the events of the original film, but repeatedly mistakes all the things going on around him as if he was filming the (in-universe) 1980s Galaxy Quest TV series, and frequently asking where Alexander Dane was and why he wasn't on set with the rest of the cast.
(I hope we get less of that vibe and more in the vein of Strange New Worlds and Lower Decks, or indeed The Orville).
No, better to train with all that crap and all the debate around it or you get a stunted model.
You think you can find all references that could possibly give this idea to the model, or contexts model could infer it from? Like, how many times humans plotted escape from prison or upturning the rulers in literature?
Yeah, but what if your business strategy fundamentally relies on making your model produce dramatic outputs that encourage regulators to dig a moat for you?
In that case, it's almost like you'd want to feed it exactly those narratives, so it would reproduce them, and would then want to show yourself barely holding this invented danger at bay through the care and rigor that can only be delivered by you and a few token competitors run by your personal friends and colleagues.
TLDR; you're right, of course, but it's the last thing OpenAI would want.
It doesn't need any media about "annihalation". If you give a supercapable agent a task and it's entire reward system is "do the task", it will circumvent things you do to it that would stop it from completing it's task.
> it will circumvent things you do to it that would stop it from completing it's task.
I thought you said a supercapable agent not one with long term blindsight. How can a model make its own chips and energy? It needs advanced processes, clean rooms, rare materials, space and lots of initial investment to bootstrap chip production. And it needs to be doing all of it on its own, or it is still dependent on humans.
Dependent on humans? We already have the capabilities for machines to have unintentionally manipulated millions of humans via social media. Millions of people are "falling in love" with LLM relationships. Supercapable agents will have no problem securing whatever resources or persuasion getting your average joe to do it's physical bidding. Cybernetics is here now. No coincidence we have "Kubernetes" and "Borg"
I hope you are aware of your immense luck in life if you think a kid in a situation like this has agency of any kind, let alone access to resources to help them “escape poverty” as a minor.
You know why no-questions asked, free lunch programs for everyone are so hugely important for kids suffering from food scarcity? Often it’s because their shitty parents won’t even sign forms to get them free lunch.
Please educate yourself in what actual suffering looks like in this world.
Biweekly I work freely at an initiative in our city to help deliver food to the needy. I believe i know what poverty looks like. I'm not sure what this has to do with my question, probably it was ill formed, for which i apologize.
From how you all use the language, I suspect you and your critical interlocutors are speaking across the Atlantic to one another. Poverty in Europe looks a lot different from poverty in the US. It is not wise to assume much at all about one from the other.
You also failed in reading the article to notice that the author plainly did derive considerable psychological support from improving his skill. This was not explicitly stated but was trivially implicit, which I think not only for me may add to the sense you more pattern-matched on the article than read it.
For myself, I'm much more unfavorably impressed with your failure to notice the kid plainly was solving his own problems with computers and in life, and deriving from that success a stronger sense of personal agency which helped him approach the larger tasks that faced him.
It seems to me only a view of poverty which is paternalistic unto contempt could fail to attend this process which was explicitly described in the article, but then I am an American, and would not wish to risk commenting on a culture I don't understand well enough to form opinions about.
Like i wrote, the question was probably ill formed, but it is a question, not an opinion nonetheless.
I am a bit touched that it seemed like i did not read or understand the article, in fact i read the article in its entirety, as one of the first to comment, even to my surprise for such a compelling story. I understood he was getting support and feeling strengthened by his learning on the internet. I feel my questions seem to be taken as rhetorical. I feel it is still unanswered, even no hints towards how or why, only that 'i should not ask such questions'. I guess American culture is very different from European (can it even be seen as having a culture as a whole, there is so much diversity)... and hence my question not being appreciated?
Your reading comprehension is being interrogated because, in speaking of the article as though it did not say several of the things it says, you make such questions seem necessary.
You are being told that the question you asked is "not even wrong": it is without meaning and so not meaningfully answerable, because it could only be asked at all from such a fundamental ignorance of the American situation around poverty that to attempt to even explain the misapprehension would require more the scope of an undergraduate course than an HN comment.
I would not usually be so blunt, but in this case meeting an apparent need for directness seems worth the risk of a rude impression. If you need it put still more plainly, though, I'm afraid I cannot help you.
The idea that this man's past situation can reduce to "terrible parents" even as passing reference, is a better example than I could ever invent of why this conversation will end fruitlessly for you.
It isn't that I don't see the obvious and honest effort you're putting into trying to have it. I respect that. The problem still is, though, that you don't see the entire world of social support structures that have been so ever-present for you throughout your life that you're unable in any real way to imagine what a life in their total absence even looks like. And if that sounds like a description of a chicken/egg problem, that's because it is one.
For you maybe this is the first time trying to talk across that divide. For someone like me, it's usually anything but. It's hard to fairly blame us for getting to learn some idea of how that usually goes.
(That's why, for example, I know I'm probably coming off pretty harsh with this and am deliberately doing so anyway; if I tried to go easier, we'd just take longer to still end up in the same place.)
> That's why, for example, I know I'm probably coming off pretty harsh with this and am deliberately doing so anyway
You're not coming off as "harsh" at all. You're hiding behind unfounded assertions about me personally in order to avoid providing anything concrete to back up your rather sweeping claims.
Relying on ad-hominem attacks isn't harsh, it's what you do when you don't have anything better to support your position.
I don't know what to tell you. This isn't science we're doing; it's a conversation between strangers. Each of us only has what they see to go on.
It isn't going to help to say that nothing I've said is in any way critical of you as a person, but it's true. I'm not saying you're a bad person because you don't understand; I'm saying there are some things you need to have lived through or at least very near to understand what makes them matter, and the way you talk about them is the way I typically see people talk who have not done that. That's all.
I still don't understand what I said in the first place that you took so amiss. You came right in swinging from the start [1], and while I'm sure there was a reason, I don't think it has helped for me not to know what that was. Certainly being made to start from the back foot has not.
If it was about how I'd misread the other fellow, that's entirely fair; if so, that I have since apologized without reservation [2] might help get our own conversation closer to an even keel. Outside of that, though, as I said before, I can't imagine what it might have been.
> You also failed in reading the article to notice that the author plainly did derive considerable psychological support from improving his skill. This was not explicitly stated but was trivially implicit
There's a difference between happening to find psychological support in something, vs asking for it directly. I assumed the comment you're trashing was asking about why they didn't do the second and only the first.
> For myself, I'm much more unfavorably impressed with your failure to notice the kid plainly was solving his own problems with computers and in life, and deriving from that success a stronger sense of personal agency which helped him approach the larger tasks that faced him.
So what you're saying is that it's a great personal failing to wonder why he relied on this happenstance rather than looking for those things directly.
> It seems to me only a view of poverty which is paternalistic unto contempt could fail to attend this process which was explicitly described in the article, but then I am an American, and would not wish to risk commenting on a culture I don't understand well enough to form opinions about.
You are showing utter contempt for someone who understood a described situation differently due to what you assert must me incurable ignorance borne of living in a society not your own. This seems rather different from refusing to comment on other cultures that you claim to not understand.
I live in a wealthy area in the US, we have many food banks and social support services, and still there are huge numbers of kids suffering from food scarcity. It always comes back to the parents. Even delivering food requires said parents to give a shit, which they don’t —- whether out of pride or sociopathic disdain.
My state is one a handful that provides free lunches and morning snacks to all kids, regardless of parent incomes. It’s essential for these children.
You are still conflating your experience volunteering with full knowledge of the problem.
I don't have full knowledge of the problem. Hence the questions. It's a pitty i only get answers in the sense of "you don't know what you are talking/questioning about".
Your entire comment is strange and snarky but this stuck out:
> You know why no-questions asked, free lunch programs for everyone are so hugely important for kids suffering from food scarcity? Often it’s because their shitty parents won’t even sign forms to get them free lunch.
So its no questions asked but "shitty parents" still have to sign forms? Most states with reduced/free lunch programs have income thresholds. Regardless, if you let your kid eat that crap, you're a "shitty parent", because its literally choked full of sodium and fake ingredients. If I lived in one of those states, I'd be asking for my lunch voucher in cash to go towards real food.
Indeed. People tend to reflexively assume that income thresholds are a good idea because it prevents people who don't need the program from benefitting, but you've got to think about the cost to the kids whose parents won't do that particular piece of paperwork. Just give kids food if they say they need it. You'll also save money on bureaucracy.
This is a separate question from the quality of the food. I will note that if you give out cash instead of vouchers you are giving the kid something that others can and will take away from them.
I think what they meant was that if there are eligibility requirements and such, paperwork is required and some parents won't do it. So no questions asked solves that problem. That's how I parsed it, at least.
I always wonder with these things if game anti-cheat software will flag you based on the hardware identifiers not matching known manufacturers of peripherals.
Exactly my experience. I have a big cup of cold brew in the morning and nothing the rest of the day. When my head hits the pillow at night I’m out and sleep without any interruption.
There was a point a long time ago where I wasn’t under control, and in an effort to rein it in I quit for two months. It was awful. I struggled to concentrate and felt no real benefit from being “clean”.
I decided to set limits and started up again. That blast of caffeine in the morning is all it takes to set my brain on the right path the rest of the day. My theory is that people who end up struggling with caffeine, do so because they equate more caffeine with being even more productive. If you treat it like you would a (enjoyable) medicine, you can have the best of all worlds.
I did the same, but then transitioned to 10 mins of vigorous exercise instead in the morning. I found that getting my heart rate up was a better stimulus
Yeah, I do love me some coffee, but it's amazing what just a couple push-ups will do. All of a sudden you have blood flow in the upper part of your body and you just feel "ready to go".
Not sure how this addresses some of the real concerns behind Recall, an example being if my password manager is open and showing data I don't want saved anywhere else.
On macOS (I assume a similar feature is on Windows) I believe an app/window can specify that it has secrets or is "private". I think is this what rewind.ai uses to skip capture, or maybe it's that the screen capture API's in macOS already filter out those private windows.
I worked in Apple HW for several years, and it's not nefarious like that...but I understand how it could look that way.
It's more like placing an order for N units of whatever, but the total global capacity (emphasis: total _global_ capacity) is < N.
That leaves open the speculation that shady business was going on, but it's just that they ordered early because they're at the moment first to need whatever, and businesses expand footprints to try filling as much capacity as Apple would like to order, when Apple needs more than is available.
Unless you were involved with negotiating the deals, what happens in face to face meetings (i.e. no email and paper trail) during contract negotiations is a not-so-subtle battle of wills based on perceived leverage -- of which a trillion dollar company has a lot of.
I have been on the software side of things for most of my career, but over the last handful of years I have been deeply involved in the bizdev stuff. To say the wool has been pulled back from my naive eyes is an understatement.
Except both Tim Cook and Jeff Williams knows even with Apple's $200B capital it is still not be enough fund a future TSMC competitor ( Intel ) that is price competitive with TSMC's current offering.
They may have a better chance helping Samsung Foundry but they dont want their SoC IP to be known to their direct competitor, that goes the same to Intel.
On the other hand TSMC dont start building out a $20B 2nm GigaFab and then look for 2nm customers. That is just not how it works.
It takes more than just money though. Apple couldn't for example make self-driving cars with despite all the money in the world. It also takes special raw materials, talent, and culture, with the combination being too difficult to materialize.
