

And books just contain a series of words. You are playing semantics games. An ebook is just a bunch of electrons shoved into a rock. Yet, somehow, it also contains knowledge.
In a less abstract way, LLMs giant relational databases that are expressed by using the relationship between previous words to select a word that might follow. It’s in the relational graph that the knowledge is stored. The information is there, and the way we’ve figured out best to get it out is by generating tokens.
I’ve been thinking lately, it would be nice to have some sort of a container format for video games. All these reverse engineered ports of console games, and new emulation is nifty, but I’m going to keep that code far away from my gaming PC.
I run a container called Wolf, that lets me do game streaming from a container, theoretically something like that would be great to minimize the risk of these. Flatpak might be able to do it, but by default the permissions are 100% from pak, so the pak can just default to having all the access it wants.