This seems kind of irrelevant? Humans have General Intelligence while having a context window of, what, 5MB, to be generous. Model weights only need to contain the capacity for abstract reasoning and querying relevant information. That they currently hold real-world information at all is kind of an artifact of how models are trained.
> Humans have General Intelligence while having a context window
Yes, but humans also have more than a context window. They also have more than memory (weights). There's a lot of things humans have besides memory. For example, human brains are not a static architecture. New neurons as well as pathways (including between existing neurons) are formed and destroyed all the time. This doesn't stop either, it continues happening throughout life.
I think your argument makes sense, but is over simplifying the human brain. I think once we start considering the complexity then this no longer makes sense. It is also why a lot of AGI research is focused on things like "test time learning" or "active learning", not to mention many other areas including dynamic architectures.
Can't continuousness be simulated by lazy evaluation? Also you're assuming the simulator is bound by the same physical limitations that exist inside the simulation which seems unreasonable to me. Simulations are usually vastly simpler than the substrate they run on.
Dude thank you SO MUCH for sharing this. I use Rectangle to tile windows and I've been looking for a way to switch between windows based on their position on my screen rather than their type for probably about a year now.
> Somebody would put up a website about their favorite pet topic and when the search engine unearthed it, that's what you got.
The difference is that reading someone's blog post forces you to take their trajectory through the material and it might not go over the exact points you're curious or confused about. With a forum like StackOverflow you often have to settle for problems that are merely close enough to your own that the solutions apply to it.
Models like ChatGPT allow you to ask for blog posts on any topic on demand and then ask for follow-up blog posts about whatever aspect of the previous blog post you want to elaborate.
The underlying pressure on the Python ecosystem is to transition to a post-Moore's law era and effectively become a HPC platform where the "same" code runs on a CPU, a GPU, multicore, clusters etc.
Python may feel the pressure more than others because of the GIL and the fact it is used in compute intensive tasks more than others.
But this major need to transition to easy and seamless HPC/heterogeneous computing is the same for all languages. The question is who will get there first.
Mojo is a superset of python, with goal to be able to run any python code and to import any python module under its own execution model, that runs magnitudes faster. Now, if that actually works as advertised, it would render python obsolete and become mojo instead, even if the authors don’t put it that way.
Lex Fridmans podcast had an interview with one of the creators recently. Chris Lattner, who is also the creator of LLVM and Swift. Recommended listen for those who haven’t heard of mojo yet, if you have 3h to spare.
THC affects people very differently in my experience. It can really run the gamut from sedative to stimulant to psychedelic depending on the person. I don't think the sativa-indica dichotomy can fully explain this because the same variety of effects can be seen from a single bowl or bag of edibles.
Yeah, for me, just not a chemical I enjoy, so. Clouds my thinking, which isn't unexpected, but also seems to do the opposite of what it does for other people: I get anxious and paranoid, and background body pain (I have a lot) becomes mentally attenuated. And yes, tried different strains, etc and it's legal here so I could have whatever I want whenever, but I really couldn't be bothered.
